-- Logs begin at Mon 2022-09-05 11:36:02 UTC, end at Mon 2022-09-05 12:53:52 UTC. -- Sep 05 12:20:07.364787 dv-cinder-801354-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 05 12:20:07.373624 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 05 12:20:07.376208 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 5 12:20:07 2022] *** Sep 05 12:20:07.376208 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 05 12:20:07.376208 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 05 12:20:07.376208 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: nodename: dv-cinder-801354-7-iscsi Sep 05 12:20:07.376208 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: machine: x86_64 Sep 05 12:20:07.376208 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: clock source: unix Sep 05 12:20:07.376208 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: pcre jit disabled Sep 05 12:20:07.376208 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: detected number of CPU cores: 4 Sep 05 12:20:07.376208 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: current working directory: / Sep 05 12:20:07.376208 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: detected binary path: /usr/bin/uwsgi-core Sep 05 12:20:07.376984 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: your processes number limit is 47680 Sep 05 12:20:07.376984 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: your memory page size is 4096 bytes Sep 05 12:20:07.376984 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: detected max file descriptor number: 2048 Sep 05 12:20:07.376984 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: lock engine: pthread robust mutexes Sep 05 12:20:07.376984 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: thunder lock: enabled Sep 05 12:20:07.376984 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 05 12:20:07.376984 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 05 12:20:07.415322 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: Python main interpreter initialized at 0x559fa5acb9c0 Sep 05 12:20:07.415322 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: python threads support enabled Sep 05 12:20:07.415322 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: your server socket listen backlog is limited to 100 connections Sep 05 12:20:07.415322 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: your mercy for graceful operations on workers is 90 seconds Sep 05 12:20:07.415905 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: mapped 403077 bytes (393 KB) for 2 cores Sep 05 12:20:07.415905 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: *** Operational MODE: preforking *** Sep 05 12:20:07.416133 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: *** uWSGI is running in multiple interpreter mode *** Sep 05 12:20:07.416133 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: spawned uWSGI master process (pid: 105951) Sep 05 12:20:07.416274 dv-cinder-801354-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 05 12:20:07.416853 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: spawned uWSGI worker 1 (pid: 105952, cores: 1) Sep 05 12:20:07.417191 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: spawned uWSGI worker 2 (pid: 105953, cores: 1) Sep 05 12:20:07.417368 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 05 12:20:08.091769 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 05 12:20:08.102378 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 05 12:20:09.205798 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:20:09.205798 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: from cryptography.utils import int_from_bytes Sep 05 12:20:09.206493 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:20:09.206493 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: from cryptography.utils import int_from_bytes Sep 05 12:20:09.273206 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:20:09.273206 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: from cryptography.utils import int_from_bytes Sep 05 12:20:09.274118 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:20:09.274118 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: from cryptography.utils import int_from_bytes Sep 05 12:20:11.705595 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 12:20:11.706215 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 12:20:11.706388 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 12:20:11.706682 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 12:20:11.707187 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 12:20:11.707354 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 12:20:11.707494 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 12:20:11.707494 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.707786 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 12:20:11.707928 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.708072 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 12:20:11.708230 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.708371 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 12:20:11.708505 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.708640 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.708782 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.708917 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.709050 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.709175 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.709329 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.709462 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.709608 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.709792 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.710017 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.710211 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.710365 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.710535 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.710693 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.710837 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.710980 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801354-7-iscsi {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.711127 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.711282 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.711442 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.711678 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.711965 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.712074 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.712290 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.712396 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.712620 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801354-7-iscsi {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.712888 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.713098 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.713260 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.713606 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.713839 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.714068 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.714477 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.714714 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.714859 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.715083 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.715305 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.715383 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.715451 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.715705 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.715810 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.716043 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.716222 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.716388 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.716567 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.716682 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.716836 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.717010 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.717154 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.717323 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.717502 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.717745 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801354-7-iscsi {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.717836 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.718066 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.718203 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.718380 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.718479 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.718693 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.718783 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.719053 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.719146 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.719370 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.719476 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.719735 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.719826 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801354-7-iscsi {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.720054 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.720216 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.720359 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.720473 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.720671 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.720780 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.720996 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.721174 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.721314 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.721495 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.721632 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.721857 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.721966 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.722230 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.722322 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.722534 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.722634 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.722841 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.723011 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.723159 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.723270 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.723460 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.723608 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.723790 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.723925 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.724040 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.724138 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.724348 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.724459 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.724669 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.725379 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.725511 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.725603 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.725833 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.725936 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.726086 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.726177 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.726363 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.726553 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.726724 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.726816 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.726952 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.727103 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.727259 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.727431 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.727602 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.727788 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.727890 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.728122 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.728225 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.728382 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.728480 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.728638 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.728774 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.728961 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.729078 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.729285 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.729387 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.729599 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.729697 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.729915 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.730018 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.730229 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.730363 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.730542 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.730630 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.730854 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.730960 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.731168 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.731258 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.731480 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.731593 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.731810 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.731930 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.732148 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.732240 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.732464 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.732552 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.732769 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.732869 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.733087 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.733190 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.733408 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.733500 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.733714 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.733806 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.734017 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.734108 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.734321 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.734412 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.734637 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.734736 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.734971 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.735063 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.735273 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.735363 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.735523 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.735643 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.735849 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.735959 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.736250 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.736354 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.736471 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.736563 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.736781 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.736886 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.737089 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.737211 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.737403 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.737523 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.737692 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.737791 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.738004 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.738108 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.738307 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.738431 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.738613 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.738765 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.738968 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.739124 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.739275 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.739426 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.739611 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.739716 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.739856 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.739962 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.740164 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.740253 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.740531 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.741187 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.741342 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.741442 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.741657 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.741746 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.741971 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.742060 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.742271 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.742369 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.742566 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.742666 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.742874 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.742963 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.743185 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.743302 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.743494 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.743615 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.743825 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.743917 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.744132 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.744230 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.744452 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.744542 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.744758 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.744858 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.745063 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.745154 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.745372 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.745476 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.745675 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.745764 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.745983 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.746081 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.746293 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.746384 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.746590 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.746686 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.746896 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.746994 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.747211 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.747303 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.747519 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.747653 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.747852 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.747943 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.748156 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.748247 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.748460 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.748551 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.748762 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.748854 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.749462 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.749756 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.749827 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.749908 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.749982 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.750056 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.750130 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.750198 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.750264 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.750337 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.750539 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.750776 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.750939 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.751091 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.751236 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.751468 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.751665 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.751813 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.751948 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.752108 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.752256 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.752414 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.752414 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.752732 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.752898 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.753061 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.753257 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.753483 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.753630 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.753778 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.753926 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.754082 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.754249 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.754399 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.754542 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:20:11.754773 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.755099 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.755253 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.755253 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.755628 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.755780 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.755915 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.756083 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.756249 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.756404 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.756550 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.756673 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.756802 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.756892 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.756983 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.757072 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.757152 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.757231 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.757317 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.757398 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.757506 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.757631 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.757787 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.757948 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.758109 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.758267 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.758426 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.758592 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.758753 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.758916 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.759080 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.759227 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.759413 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.759587 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.759763 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.759939 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.760085 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.760258 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.760408 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.760598 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.760800 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.760935 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.761178 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.761280 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.761493 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.761581 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.761804 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.761893 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.762130 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.762226 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.762579 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.762896 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.763217 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.763462 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.763571 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.763868 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.764006 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.764183 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.764272 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.764496 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.764585 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.764808 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.764899 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.765121 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.765213 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.765433 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.765551 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.765776 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.765928 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.766075 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.766191 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.766392 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.766492 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.766711 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.766808 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.767029 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.767119 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.767347 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.767443 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.767685 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.767787 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.768009 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.768111 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.768318 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.768414 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.768624 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.768720 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.768929 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.769018 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.769236 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.769338 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.769548 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.769637 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.769853 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.769941 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.770176 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.770266 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.770491 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.770585 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.770799 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.770886 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.771118 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.771207 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.771430 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.771516 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.771814 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.771910 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.772132 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.772223 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.772441 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.772577 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.772752 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.772841 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.773058 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.773148 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.773368 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.773456 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.773675 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.773775 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.773995 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.774126 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.774311 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.774401 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.774618 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.774719 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.774938 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.775026 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.775245 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.775334 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.775583 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.775690 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.775891 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.775980 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.776201 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.776290 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.776509 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.776605 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.776819 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.776907 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.777131 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.777231 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.777437 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.777527 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.777760 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.777847 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.778072 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.778166 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.778384 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.778473 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.778711 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.778799 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.779014 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.779102 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.779322 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.779410 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.779673 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.779772 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.779991 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.780078 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.780298 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.780388 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.780610 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.780702 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.780916 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.781046 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.781222 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.781324 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.781524 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.781613 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.781831 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.781934 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.782135 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.782232 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.782438 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.782527 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.782743 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.782845 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.783046 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.783136 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.783348 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.783437 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.783700 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.783809 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.784013 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.784103 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.784320 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.784410 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.784627 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.784716 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.784926 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.785013 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.785229 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.785322 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.785566 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.785703 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.786069 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.786177 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.786269 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.786382 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.786546 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.786698 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.786869 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.787012 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.787184 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.787954 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.788077 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.788274 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.788372 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.788604 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.788712 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.788947 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.789083 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.789261 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.789357 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.789588 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.789701 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.789895 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.789987 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.790215 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.790305 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.790523 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.790620 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.790846 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.790943 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.791158 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.791246 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.791480 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.791590 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.791810 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.791960 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.792128 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.792219 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.792466 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.792561 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.792797 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.792896 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.793116 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.793205 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.793437 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.793616 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.793749 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.793836 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.794063 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.794187 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.794374 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.794480 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.794717 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.794814 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.795082 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.795177 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.795393 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.795490 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.795739 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.795833 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.796049 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.796143 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.796364 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.796462 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.796674 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.796770 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.796995 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.797083 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.797302 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.797399 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.797620 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.797709 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.797977 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.798074 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.798297 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.798387 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.798626 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.798716 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.798959 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.799049 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.799266 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.799356 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.799597 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.799690 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.799925 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.800013 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.800231 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.800319 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.800541 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.800637 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.800852 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.800950 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.801156 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.801245 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.801460 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.801561 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.801766 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.801868 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.802077 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.802168 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.802384 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.802478 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.802693 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.802795 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.803058 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.803712 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.803933 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.804058 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.804234 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.804516 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.804604 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.804685 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.804839 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.804992 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.805146 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.805280 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.805472 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.805596 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.805780 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.805893 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.806097 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.806197 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.806415 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.806517 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.806761 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.806870 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.807095 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.807208 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.807418 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.807517 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.807758 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.807847 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.808066 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.808164 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.808379 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.808481 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.808682 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.808783 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.809026 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.809128 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.809338 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.809439 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.809685 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.809792 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.810008 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.810114 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.810331 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.810446 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.810634 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.810733 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.810949 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.811049 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.811257 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.811345 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.811602 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.811715 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.811906 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.811993 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.812217 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.812309 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.812522 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.812619 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.812829 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.812917 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.813138 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.813233 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.813450 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.813540 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.813762 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.813858 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.814084 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.814184 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.814391 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.814479 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.814701 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.814789 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.815012 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.815107 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.815316 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.815406 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.815649 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.815739 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.815970 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.816058 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.816287 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.816906 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.817018 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.817090 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.817209 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.817209 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.817346 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.817534 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.817614 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.817883 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.818019 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.818183 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.818329 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.818519 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.818656 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.818855 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.818994 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.819165 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.819268 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.819475 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.819626 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.819820 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.819922 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.820124 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.820221 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.820433 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.820732 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.820851 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.821072 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.821161 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.821380 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.821471 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.821684 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.821782 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.821993 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.822082 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.822298 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.822401 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.822603 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.822692 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.822907 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.822996 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.823197 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.823301 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.823509 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.823680 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.823834 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.823923 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.824149 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.824271 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.824455 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.824555 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.824781 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.824932 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.825120 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.825271 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.825441 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.825600 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.825748 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.825856 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.825981 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.826078 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.826280 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.826381 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.826584 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.826681 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.827043 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.827511 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.828390 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.828975 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.829551 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.830279 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.830526 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.830695 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.830782 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.830870 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.830959 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.831049 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.831130 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.831217 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.831299 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.831378 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.831457 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.831567 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.831651 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.831731 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.831810 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.831888 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.831967 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.832063 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.832359 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.832503 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.832643 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.832763 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.832859 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.832941 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.833020 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.833107 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.833187 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.833376 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.833477 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.833559 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.833638 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.833724 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.833805 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.833908 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.833999 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.834080 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.834159 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.834236 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.834310 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.834379 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.834466 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.834554 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.834641 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.834721 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.834799 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.834886 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.835017 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.835173 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.835286 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.835418 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.835642 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.835823 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.835977 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.836227 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.836378 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.836531 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.836679 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.836798 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.836883 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.836973 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.837097 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.837244 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.837403 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.837547 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.837709 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.837869 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.838027 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.838179 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.838341 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.838502 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.838651 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.838797 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.838942 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.839087 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.839498 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.839720 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.839857 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.839985 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.840124 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.840264 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.840428 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.840559 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.840692 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.840819 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.841003 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.841141 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.841368 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.841460 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.841676 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.841766 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.842051 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.842148 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.842361 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.842510 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.842671 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.842759 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.842974 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.843074 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.843273 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.843362 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.843600 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.843718 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.843908 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.844021 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.844212 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.844309 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.844691 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.845333 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.845333 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.846967 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.847074 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.847307 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.847441 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.847612 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.847771 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.847895 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.848023 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.848148 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.848283 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.848419 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.848419 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.848689 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.848830 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.848965 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.849102 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.849254 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.849506 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.849655 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.850289 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.850384 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.850453 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.850520 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.850603 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.850692 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.850773 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.850841 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.850907 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.850980 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.851048 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.851123 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.851203 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.851277 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.851277 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.851491 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.851670 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.851811 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.851950 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.852078 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.852163 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.852243 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.852243 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.852377 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.852443 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.852526 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.852710 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.852812 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.852902 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.852971 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.853037 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.853103 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.853277 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.853367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.853598 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.853685 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.853915 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.854003 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.854227 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.854314 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.854531 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.854617 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.854839 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.854926 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.855152 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.855240 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.855466 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.855572 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.855825 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.855912 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.856135 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.856223 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.856444 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.856539 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.856759 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.856881 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.857069 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.857171 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.857369 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.857468 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.857694 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.857805 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.858004 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.858098 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.858303 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.858396 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.858613 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.858714 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.858918 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.859007 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.859234 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.859328 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.859552 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.859654 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.859880 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.859995 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.860195 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.860311 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.860507 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.860623 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.860895 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.861000 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.861161 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.861304 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.861453 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.861589 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.861780 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.861923 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.862094 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.862242 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.862388 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.862530 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.862716 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.862878 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.863004 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.863128 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.863328 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.863467 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.863662 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.863801 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.864025 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.864163 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.864329 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.864456 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.864639 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.864765 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.864960 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.865100 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.865264 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.865391 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.866172 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.866346 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.866481 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.866616 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.866756 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.866988 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.867116 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.867237 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.867358 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.867505 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.867753 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.867880 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.868067 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.868180 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.868374 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.868513 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.868735 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.868867 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.869043 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.869176 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.869358 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.869484 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.869684 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.869811 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.870001 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.870126 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.870308 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.870433 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.870614 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.870752 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.870932 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.871057 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.871238 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.871371 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.871579 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.871722 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.871908 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.872034 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.872220 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.872345 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.872536 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.872663 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.872839 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.873016 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.873143 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.873332 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.873459 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.873646 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.873772 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.873972 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.874106 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.874295 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.874462 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.874622 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.874782 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.874934 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.875092 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.875252 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.875414 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.875604 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.875763 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.875905 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.876070 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.876233 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.876359 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.876550 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.876675 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.876867 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.877004 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.877213 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.877341 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.877470 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.877585 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.877795 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.877931 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.878127 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.878268 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.878458 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.878588 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.878720 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.878904 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.879082 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.879278 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.879477 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.879720 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.879939 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.880153 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.880353 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.880552 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.880752 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.880907 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.881069 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.881195 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.881327 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.881450 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.881572 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.881702 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.881871 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.882014 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.882140 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.882277 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.882405 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.882531 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.882735 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.882866 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.882983 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.883091 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.883197 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.883303 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.883418 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.883525 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.883676 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.883796 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.883912 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.884133 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.884282 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.884474 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.884590 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.884802 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.884917 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.885120 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.885250 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.885447 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.885573 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.885768 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.885894 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.886075 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.886203 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.886390 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.886536 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.886719 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.886868 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.887059 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.887202 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.887406 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.887555 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.887696 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.887907 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.888047 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.888195 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.888346 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.888478 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.888697 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.888840 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.888967 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.889090 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.889213 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.889335 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.889498 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.889632 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.889757 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.889880 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.890071 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.890199 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.890377 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.890512 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.890697 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.890825 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.891009 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.891143 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.891417 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.891611 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.891740 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.891863 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.891985 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.892121 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.892315 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.892457 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.892625 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.892752 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.893002 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.893132 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.893323 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.893459 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.893641 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.893777 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.893951 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.894078 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.894258 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.894387 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.894564 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.894691 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.894892 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.895100 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.895225 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.895361 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.895511 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.895735 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.895882 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.896021 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.896136 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.896258 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.896441 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.896576 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.896796 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.896933 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.897114 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.897240 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.897451 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.897686 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.897808 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.898072 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.898214 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.898388 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.898515 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.898703 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.898840 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.899022 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.899150 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.899368 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.899507 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.899667 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.899804 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.899979 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.900109 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.900294 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.900422 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.900608 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.900750 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.900921 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.901050 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.901252 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.901380 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.901576 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.901713 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.901896 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.902022 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.902230 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.902464 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.902669 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.902825 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.902953 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.903147 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.903274 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.903459 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.903655 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.903790 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.903950 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.904110 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.904245 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.904429 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.904556 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.904740 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.904866 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.905052 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.905177 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.905364 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.905491 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.905678 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.905804 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.905987 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.906112 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.906303 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.906433 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.906617 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.906745 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.906930 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.907066 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.907241 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.907367 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.907573 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.907713 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.907891 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.908006 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.908217 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.908333 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.908553 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.908653 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.908873 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.908971 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.909191 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.909281 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.909508 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.909643 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.909820 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.909935 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.910192 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.910348 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.910509 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.910668 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.910828 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.911004 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.911128 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.911333 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.911446 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.911681 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.911787 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.911999 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.912088 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.912848 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.913001 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.913176 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.913276 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.913484 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.913573 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.913794 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.913882 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.914107 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.914197 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.914417 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.914506 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.914721 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.914817 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.915041 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.915137 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.915352 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.915638 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.915730 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.915984 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.916082 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.916292 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.916443 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.916633 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.916821 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.916970 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.917174 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.917305 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.917491 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.917619 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.917824 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.917983 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.918111 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.918234 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.918429 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.918567 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.918738 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.918876 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.919060 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.919196 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.919363 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.919489 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.919690 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.919827 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.920008 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.920137 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.920314 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.920439 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.920615 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.920749 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.920922 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.921070 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.921232 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.921480 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.921617 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.921831 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.921957 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.922141 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.922276 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.922447 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.922587 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.922775 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.922902 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.923080 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.923207 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.923383 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.923512 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.923713 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.923841 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.924028 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.924156 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.924337 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.924472 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.924659 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.924799 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.924975 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.925104 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.925283 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.925436 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.925670 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.925808 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.926006 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.926318 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.926441 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.926550 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.926673 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.926803 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.926927 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.927059 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.927183 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.927304 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.927427 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.927580 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.927756 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.928584 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.928718 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.928840 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.928961 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.929083 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.929205 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.929337 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.929512 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.929641 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.929825 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.929969 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.930142 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.930279 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.930445 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.930574 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.930761 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.930926 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.931099 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.931232 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.931412 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.931566 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.931870 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.932009 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.932232 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.932363 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.932564 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.932692 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.932878 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.933005 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.933204 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.933329 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.933498 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.933625 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.933808 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.933933 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.934112 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.934239 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.934428 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.934552 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.934734 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.934870 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.935045 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.935166 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.935353 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.935478 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.935684 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.935822 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.935994 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.936120 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.936302 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.936430 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.936611 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.936867 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.936996 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.937207 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.937332 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.937511 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.937645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.937819 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.937959 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.938166 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.938295 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.938417 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.938554 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.938711 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.938833 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.939024 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.939151 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.939365 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.939501 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.939714 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.939841 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.940030 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.940155 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.940341 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.940480 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.940651 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.940775 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.940954 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.941080 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.941263 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.941389 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.941566 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.941691 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.941877 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.942003 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.942192 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.942321 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.942519 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.942649 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.942831 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.942958 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.943135 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.943265 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.943472 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.943834 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.943959 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.944155 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.944286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.944510 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.944634 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.944837 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.944964 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.945151 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.945273 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.945476 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.945602 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.945803 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.945930 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.946118 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.946246 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.946441 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.946567 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.946753 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.946893 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.947083 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.947209 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.947423 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.947573 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.947777 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.947917 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.948104 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.948310 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.948438 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.948568 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.948692 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.948997 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.949271 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.949398 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.949594 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.949721 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.949905 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.950031 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.950210 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.950346 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.950513 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.950641 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.950821 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.950949 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.951126 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.951261 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.951431 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.951616 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.951756 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.951910 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.952039 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.952227 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.952355 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.952563 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.952733 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.952910 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.953037 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.953208 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.953376 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.953510 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.953636 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.953797 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.953924 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.954098 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.954226 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.954406 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.954533 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.954710 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.954838 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.955014 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.955142 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.955317 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.955445 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.955691 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.955836 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.955961 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.956096 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.956259 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.956387 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.956585 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.956710 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.956899 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.957076 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.957251 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.957420 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.957548 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.957671 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.957808 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.957943 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.958068 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.958202 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.958408 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.958544 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.958682 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.958816 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.958972 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.959099 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.959305 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.959432 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.959622 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.959757 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.959962 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.960090 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.960273 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.960407 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.960581 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.960709 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.960887 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.961017 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.961194 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.961321 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.961501 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.961629 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.961834 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.961961 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.962167 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.962299 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.962502 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.962628 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.962780 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.962908 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.963098 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.963233 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.963415 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.963582 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.963756 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.963893 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.964098 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.964515 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.964674 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.964799 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.964984 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.965111 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.965297 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.965438 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.965609 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.965744 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.965923 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.966051 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.966238 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.966365 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.966552 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.966684 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.966863 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.966988 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.967170 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.967297 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.967481 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.967651 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.967822 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.967948 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.968149 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.968284 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.968525 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.968660 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.968791 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.968914 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.969089 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.969216 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.969410 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.969544 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.969755 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.969888 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.970072 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.970199 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.970407 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.970534 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.970727 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.970862 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.971040 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.971165 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.971351 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.971476 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.971679 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.971816 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.971941 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 12:20:11.972064 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.972305 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.972620 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.972938 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.973257 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.973579 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.973908 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.974237 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.974552 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.975401 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.975760 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.976117 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.976438 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.976791 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.977174 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.977489 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.977809 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.978121 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:20:11.978371 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 12:20:12.126335 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO dbcounter [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] Registered counter for database nova_api Sep 05 12:20:12.132690 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO dbcounter [None req-32f6617d-439f-4f51-b919-12efdeda40a2 None None] Registered counter for database nova_api Sep 05 12:20:12.148912 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_db.sqlalchemy.engines [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:20:12.153468 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG oslo_db.sqlalchemy.engines [None req-32f6617d-439f-4f51-b919-12efdeda40a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:20:12.155762 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG dbcounter [-] [105953] Writer thread running {{(pid=105953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:20:12.160055 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG dbcounter [-] [105952] Writer thread running {{(pid=105952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:20:12.213716 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.context [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),81343397-9614-45e8-9ed8-cbb978677508(cell1) {{(pid=105953) load_cells /opt/stack/nova/nova/context.py:464}} Sep 05 12:20:12.217772 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.context [None req-32f6617d-439f-4f51-b919-12efdeda40a2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),81343397-9614-45e8-9ed8-cbb978677508(cell1) {{(pid=105952) load_cells /opt/stack/nova/nova/context.py:464}} Sep 05 12:20:12.217911 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:12.218250 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:12.219846 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:12.220725 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:12.221170 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:12.221653 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG oslo_concurrency.lockutils [None req-32f6617d-439f-4f51-b919-12efdeda40a2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:12.222128 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG oslo_concurrency.lockutils [None req-32f6617d-439f-4f51-b919-12efdeda40a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:12.223365 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:12.223736 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG oslo_concurrency.lockutils [None req-32f6617d-439f-4f51-b919-12efdeda40a2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:12.224473 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG oslo_concurrency.lockutils [None req-32f6617d-439f-4f51-b919-12efdeda40a2 None None] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:20:12.225558 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG oslo_concurrency.lockutils [None req-32f6617d-439f-4f51-b919-12efdeda40a2 None None] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:20:12.225963 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO dbcounter [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] Registered counter for database nova_cell0 Sep 05 12:20:12.227649 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG oslo_concurrency.lockutils [None req-32f6617d-439f-4f51-b919-12efdeda40a2 None None] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:20:12.229675 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO dbcounter [None req-32f6617d-439f-4f51-b919-12efdeda40a2 None None] Registered counter for database nova_cell0 Sep 05 12:20:12.230108 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO dbcounter [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] Registered counter for database nova_cell1 Sep 05 12:20:12.233811 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO dbcounter [None req-32f6617d-439f-4f51-b919-12efdeda40a2 None None] Registered counter for database nova_cell1 Sep 05 12:20:12.237120 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_db.sqlalchemy.engines [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:20:12.239491 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_db.sqlalchemy.engines [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:20:12.241752 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG oslo_db.sqlalchemy.engines [None req-32f6617d-439f-4f51-b919-12efdeda40a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:20:12.243876 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG oslo_db.sqlalchemy.engines [None req-32f6617d-439f-4f51-b919-12efdeda40a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:20:12.244196 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG dbcounter [-] [105953] Writer thread running {{(pid=105953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:20:12.251016 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG dbcounter [-] [105952] Writer thread running {{(pid=105952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:20:12.252558 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG dbcounter [-] [105952] Writer thread running {{(pid=105952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:20:12.383405 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG dbcounter [-] [105953] Writer thread running {{(pid=105953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:20:12.392238 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO dbcounter [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] Registered counter for database nova_cell0 Sep 05 12:20:12.400138 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO dbcounter [None req-32f6617d-439f-4f51-b919-12efdeda40a2 None None] Registered counter for database nova_cell0 Sep 05 12:20:12.402311 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_db.sqlalchemy.engines [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:20:12.407277 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG dbcounter [-] [105953] Writer thread running {{(pid=105953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:20:12.410183 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG oslo_db.sqlalchemy.engines [None req-32f6617d-439f-4f51-b919-12efdeda40a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:20:12.415383 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG dbcounter [-] [105952] Writer thread running {{(pid=105952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:20:12.855290 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: WARNING keystonemiddleware.auth_token [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 12:20:12.862703 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: WARNING keystonemiddleware.auth_token [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 12:20:13.007586 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: WARNING keystonemiddleware.auth_token [None req-32f6617d-439f-4f51-b919-12efdeda40a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 12:20:13.014962 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: WARNING keystonemiddleware.auth_token [None req-32f6617d-439f-4f51-b919-12efdeda40a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 12:20:13.202992 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: WARNING keystonemiddleware.auth_token [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 12:20:13.209289 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: WARNING keystonemiddleware.auth_token [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 12:20:13.215247 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559fa5acb9c0 pid: 105953 (default app) Sep 05 12:20:13.217594 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:20:13.218823 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] 10.222.0.62 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001927 Sep 05 12:20:13.219256 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 788 bytes} [Mon Sep 5 12:20:13 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:20:13.363708 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: WARNING keystonemiddleware.auth_token [None req-32f6617d-439f-4f51-b919-12efdeda40a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 12:20:13.370338 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: WARNING keystonemiddleware.auth_token [None req-32f6617d-439f-4f51-b919-12efdeda40a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 12:20:13.375661 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559fa5acb9c0 pid: 105952 (default app) Sep 05 12:21:38.704587 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:38.706468 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002446 Sep 05 12:21:38.706872 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 2/2] 10.222.0.62 () {54 vars in 931 bytes} [Mon Sep 5 12:21:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:21:38.720029 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG dbcounter [-] [105952] Writing DB stats nova_api:SELECT=3 {{(pid=105952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:21:38.721650 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG dbcounter [-] [105952] Writing DB stats nova_cell1:SELECT=3 {{(pid=105952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:21:38.722748 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG dbcounter [-] [105952] Writing DB stats nova_cell0:SELECT=3 {{(pid=105952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:21:38.724999 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG dbcounter [-] [105952] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:21:39.650919 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-fe16f915-b3b3-42af-82a2-bdac3355f8de admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:39.683483 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-fe16f915-b3b3-42af-82a2-bdac3355f8de admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.969029 Sep 05 12:21:39.684295 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 1/3] 10.222.0.62 () {60 vars in 1292 bytes} [Mon Sep 5 12:21:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:42.123761 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:42.124853 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-04b32c25-b0aa-43f7-bf91-4f124719f66f None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001615 Sep 05 12:21:42.125539 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 3/4] 10.222.0.62 () {54 vars in 931 bytes} [Mon Sep 5 12:21:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:21:42.604666 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-63fb4eac-21e7-4f70-b4d6-31f28a3f298b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "vcpus": 1, "swap": 0, "name": "cirros256", "ram": 256}} {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:21:42.747667 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-63fb4eac-21e7-4f70-b4d6-31f28a3f298b admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.614964 Sep 05 12:21:42.748487 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 2/5] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Sep 5 12:21:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 12:21:42.764112 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG dbcounter [-] [105953] Writing DB stats nova_api:SELECT=3 {{(pid=105953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:21:42.765112 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG dbcounter [-] [105953] Writing DB stats nova_cell0:SELECT=3 {{(pid=105953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:21:42.766465 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG dbcounter [-] [105953] Writing DB stats nova_cell1:SELECT=3 {{(pid=105953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:21:42.767887 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG dbcounter [-] [105953] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:21:42.991760 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-4685387c-4c63-42ea-8207-dd4a5acb7328 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:21:43.167791 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-4685387c-4c63-42ea-8207-dd4a5acb7328 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.409960 Sep 05 12:21:43.168594 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 4/6] 10.222.0.62 () {64 vars in 1336 bytes} [Mon Sep 5 12:21:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:21:45.590217 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-63fb4eac-21e7-4f70-b4d6-31f28a3f298b admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:45.591208 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-63fb4eac-21e7-4f70-b4d6-31f28a3f298b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 05 12:21:45.591848 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 3/7] 10.222.0.62 () {54 vars in 931 bytes} [Mon Sep 5 12:21:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:21:46.325704 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-30a0def9-7338-4fcc-bc4e-fba830289501 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "os-flavor-access:is_public": true, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0}} {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:21:46.621081 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-30a0def9-7338-4fcc-bc4e-fba830289501 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.022503 Sep 05 12:21:46.621774 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 5/8] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Sep 5 12:21:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:21:46.635517 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-4f4e0f1d-e99e-4192-a1ec-caff6e1ac7c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:21:46.773463 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-4f4e0f1d-e99e-4192-a1ec-caff6e1ac7c5 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.143446 Sep 05 12:21:46.777068 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 4/9] 10.222.0.62 () {64 vars in 1336 bytes} [Mon Sep 5 12:21:46 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:49.203034 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-30a0def9-7338-4fcc-bc4e-fba830289501 admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:49.204131 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-30a0def9-7338-4fcc-bc4e-fba830289501 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Sep 05 12:21:49.204562 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 6/10] 10.222.0.62 () {54 vars in 931 bytes} [Mon Sep 5 12:21:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:21:49.636509 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-6ef0bcf9-85a8-455e-8918-257a493733f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:21:49.793300 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-6ef0bcf9-85a8-455e-8918-257a493733f8 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.581967 Sep 05 12:21:49.794065 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 5/11] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Sep 5 12:21:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:21:49.807012 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-62d5622d-b510-4239-b9d8-691f61df2b11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:21:49.889431 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-62d5622d-b510-4239-b9d8-691f61df2b11 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086577 Sep 05 12:21:49.890151 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 7/12] 10.222.0.62 () {64 vars in 1336 bytes} [Mon Sep 5 12:21:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:52.350855 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-6ef0bcf9-85a8-455e-8918-257a493733f8 admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:52.351897 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-6ef0bcf9-85a8-455e-8918-257a493733f8 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 05 12:21:52.352295 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 6/13] 10.222.0.62 () {54 vars in 931 bytes} [Mon Sep 5 12:21:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:21:52.828067 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-7e9599c3-7a09-4f68-b5ff-732cb84dfb6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d3"}} {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:21:53.077345 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-7e9599c3-7a09-4f68-b5ff-732cb84dfb6a admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.718301 Sep 05 12:21:53.078018 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 8/14] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Sep 5 12:21:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:21:53.090462 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-96795e50-a944-4d1a-9e27-9b4260f1604d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:21:53.231141 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-96795e50-a944-4d1a-9e27-9b4260f1604d admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.144559 Sep 05 12:21:53.231963 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 7/15] 10.222.0.62 () {64 vars in 1336 bytes} [Mon Sep 5 12:21:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:55.651977 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-7e9599c3-7a09-4f68-b5ff-732cb84dfb6a admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:55.652987 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-7e9599c3-7a09-4f68-b5ff-732cb84dfb6a admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Sep 05 12:21:55.653424 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 9/16] 10.222.0.62 () {54 vars in 931 bytes} [Mon Sep 5 12:21:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:21:56.156183 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-52f869ad-ed30-4b3c-b517-461db8e342ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "id": "d4", "rxtx_factor": 1.0}} {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:21:56.276765 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-52f869ad-ed30-4b3c-b517-461db8e342ca admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.617211 Sep 05 12:21:56.278015 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 8/17] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Sep 5 12:21:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:21:56.290606 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-32058af0-577d-4763-ad3d-ea9695924b8f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:21:56.404261 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-32058af0-577d-4763-ad3d-ea9695924b8f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117631 Sep 05 12:21:56.404790 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 10/18] 10.222.0.62 () {64 vars in 1336 bytes} [Mon Sep 5 12:21:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:21:59.150039 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-52f869ad-ed30-4b3c-b517-461db8e342ca admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:59.150982 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-52f869ad-ed30-4b3c-b517-461db8e342ca admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 05 12:21:59.151382 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 9/19] 10.222.0.62 () {54 vars in 931 bytes} [Mon Sep 5 12:21:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:21:59.613874 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-85bc16c6-4d22-4b9c-a5d3-ce8383bcf982 admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:21:59.639485 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-85bc16c6-4d22-4b9c-a5d3-ce8383bcf982 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.480945 Sep 05 12:21:59.640066 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 11/20] 10.222.0.62 () {60 vars in 1292 bytes} [Mon Sep 5 12:21:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:22:02.163237 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-52f869ad-ed30-4b3c-b517-461db8e342ca admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:02.164307 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-52f869ad-ed30-4b3c-b517-461db8e342ca admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 05 12:22:02.164734 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 10/21] 10.222.0.62 () {54 vars in 931 bytes} [Mon Sep 5 12:22:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:22:02.589952 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-039362cf-7760-4b33-94fd-2aba942209e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "ram": 512, "name": "m1.tiny", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:02.671030 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-039362cf-7760-4b33-94fd-2aba942209e3 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.499810 Sep 05 12:22:02.671593 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 12/22] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Sep 5 12:22:02 2022] POST /compute/v2.1/flavors => generated 402 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:22:02.684137 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-4ebf3371-2342-4392-ad08-b8f7c4afa32b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:02.760502 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-4ebf3371-2342-4392-ad08-b8f7c4afa32b admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080622 Sep 05 12:22:02.761297 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 11/23] 10.222.0.62 () {64 vars in 1333 bytes} [Mon Sep 5 12:22:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:05.119421 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-039362cf-7760-4b33-94fd-2aba942209e3 admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:05.120456 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-039362cf-7760-4b33-94fd-2aba942209e3 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Sep 05 12:22:05.120849 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 13/24] 10.222.0.62 () {54 vars in 931 bytes} [Mon Sep 5 12:22:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:22:05.522455 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-9a977bba-0797-47a6-b0d8-0098c861aa47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "2", "name": "m1.small"}} {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:05.671736 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-9a977bba-0797-47a6-b0d8-0098c861aa47 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.544949 Sep 05 12:22:05.675671 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 12/25] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Sep 5 12:22:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:22:05.685368 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-e62bf308-de49-42e8-8f9e-2b7f31a42053 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:05.775063 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-e62bf308-de49-42e8-8f9e-2b7f31a42053 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093922 Sep 05 12:22:05.775730 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 14/26] 10.222.0.62 () {64 vars in 1333 bytes} [Mon Sep 5 12:22:05 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:08.229875 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-9a977bba-0797-47a6-b0d8-0098c861aa47 admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:08.230884 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-9a977bba-0797-47a6-b0d8-0098c861aa47 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 05 12:22:08.231282 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 13/27] 10.222.0.62 () {54 vars in 931 bytes} [Mon Sep 5 12:22:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:22:08.716205 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-57e68d9f-1268-4c70-90ae-e8c3dec2c03e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.medium", "disk": 40, "ram": 4096, "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:08.850993 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-57e68d9f-1268-4c70-90ae-e8c3dec2c03e admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.613433 Sep 05 12:22:08.851914 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 15/28] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Sep 5 12:22:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:22:08.865000 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-67c359b4-d3fb-469c-8179-22729972f720 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:08.989137 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-67c359b4-d3fb-469c-8179-22729972f720 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.127841 Sep 05 12:22:09.000319 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 14/29] 10.222.0.62 () {64 vars in 1333 bytes} [Mon Sep 5 12:22:08 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:11.418649 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-57e68d9f-1268-4c70-90ae-e8c3dec2c03e admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:11.419828 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-57e68d9f-1268-4c70-90ae-e8c3dec2c03e admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 05 12:22:11.420468 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 16/30] 10.222.0.62 () {54 vars in 931 bytes} [Mon Sep 5 12:22:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:22:11.903760 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-7803b484-bd0e-41f4-bc5f-01c756ec9c67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "id": "4", "name": "m1.large"}} {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:11.909559 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG dbcounter [-] [105952] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:11.988984 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-7803b484-bd0e-41f4-bc5f-01c756ec9c67 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.562218 Sep 05 12:22:11.991585 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 15/31] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Sep 5 12:22:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:22:12.001831 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-798c7dd7-38f2-445b-add3-ca97fac46a6f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:12.102679 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-798c7dd7-38f2-445b-add3-ca97fac46a6f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104544 Sep 05 12:22:12.103456 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 17/32] 10.222.0.62 () {64 vars in 1333 bytes} [Mon Sep 5 12:22:11 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:14.643990 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-7803b484-bd0e-41f4-bc5f-01c756ec9c67 admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:14.644939 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-7803b484-bd0e-41f4-bc5f-01c756ec9c67 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 05 12:22:14.645296 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 16/33] 10.222.0.62 () {54 vars in 931 bytes} [Mon Sep 5 12:22:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:22:15.129689 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-50e21a0b-f679-43d0-96aa-35ba49b958fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0, "name": "m1.xlarge", "id": "5", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:15.263002 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-50e21a0b-f679-43d0-96aa-35ba49b958fc admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.611016 Sep 05 12:22:15.263991 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 18/34] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Sep 5 12:22:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:22:15.277396 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-06189dd0-8232-4cc7-b578-0dbc09f77a84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:15.434191 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-06189dd0-8232-4cc7-b578-0dbc09f77a84 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.161457 Sep 05 12:22:15.434778 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 17/35] 10.222.0.62 () {64 vars in 1333 bytes} [Mon Sep 5 12:22:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:22:33.682828 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-50e21a0b-f679-43d0-96aa-35ba49b958fc admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:33.683864 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-50e21a0b-f679-43d0-96aa-35ba49b958fc admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 05 12:22:33.684257 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 19/36] 10.222.0.62 () {54 vars in 931 bytes} [Mon Sep 5 12:22:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:22:34.105989 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-01f2b32d-6cb0-4f83-a9fe-08b532819f23 admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:34.125010 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-01f2b32d-6cb0-4f83-a9fe-08b532819f23 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.434210 Sep 05 12:22:34.125484 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 18/37] 10.222.0.62 () {60 vars in 1292 bytes} [Mon Sep 5 12:22:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:22:35.246943 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-50e21a0b-f679-43d0-96aa-35ba49b958fc admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:35.247982 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-50e21a0b-f679-43d0-96aa-35ba49b958fc admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 05 12:22:35.248379 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 20/38] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Sep 5 12:22:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:22:35.788429 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-a620e278-2caa-42a0-8744-410dffd3dd89 admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:35.794367 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.wsgi [None req-a620e278-2caa-42a0-8744-410dffd3dd89 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-a620e278-2caa-42a0-8744-410dffd3dd89 admin admin] Request method failure captured: Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Accept: application/json Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Accept-Encoding: gzip, deflate Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Connection: keep-alive Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Content-Length: 0 Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Host: 10.222.0.62 Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Openstack-Api-Version: compute 2.92 Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Openstack-System-Scope: None Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: User-Agent: python-novaclient Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Auth-Token: gAAAAABjFeoLRZLBbOB2qa7_JLt2gtZyq48aDct9toqM6RXDOX3v6Hdtzpd5sW0Sk5bHd9TiHC9Gb64oxqaU1ZqlJGl71S2gh4cUQEzQTfWGihXVU_3F0dH5SDt87daZAqRdoUmf8N_SJnhbDzXVUQQ8-F8mDP4yuBFUChZeFMTaGfi8fGhDv3E Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Domain-Id: None Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Domain-Name: None Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Identity-Status: Confirmed Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Is-Admin-Project: True Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Project-Domain-Id: default Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Project-Domain-Name: Default Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Project-Id: d80f282fe9da41e0b08a14ba58840408 Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Project-Name: admin Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Role: member,admin,reader Sep 05 12:22:35.797658 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Roles: member,admin,reader Sep 05 12:22:35.799313 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:22:35.799313 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Tenant: admin Sep 05 12:22:35.799313 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Tenant-Id: d80f282fe9da41e0b08a14ba58840408 Sep 05 12:22:35.799313 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Tenant-Name: admin Sep 05 12:22:35.799313 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-User: admin Sep 05 12:22:35.799313 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-User-Domain-Id: default Sep 05 12:22:35.799313 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-User-Domain-Name: Default Sep 05 12:22:35.799313 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-User-Id: 57929111b78840da8ec77704273d56d2 Sep 05 12:22:35.799313 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-User-Name: admin Sep 05 12:22:35.799313 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: method: > Sep 05 12:22:35.799313 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: exception: Flavor 42 could not be found. Sep 05 12:22:35.799313 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: action_args: {'id': '42'} Sep 05 12:22:35.799313 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:22:35.799313 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:22:35.800365 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 12:22:35.800365 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 12:22:35.800365 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 12:22:35.800365 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 12:22:35.800365 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 12:22:35.800365 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 12:22:35.800365 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 12:22:35.800365 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 12:22:35.800365 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 12:22:35.800365 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:22:35.800365 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 12:22:35.800365 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 12:22:35.800365 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 05 12:22:35.800365 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Sep 05 12:22:35.800365 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:22:35.800365 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Sep 05 12:22:35.800365 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:22:35.800365 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:22:35.800365 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:22:35.801794 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:22:35.801794 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:22:35.801794 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:22:35.801794 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:22:35.801794 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 12:22:35.801794 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:22:35.801794 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 05 12:22:35.801794 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Sep 05 12:22:35.801794 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:22:35.801794 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Sep 05 12:22:35.801794 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:22:35.801794 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:22:35.801794 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:22:35.801794 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:22:35.801794 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:22:35.801794 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 05 12:22:35.801794 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Sep 05 12:22:35.801794 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-a620e278-2caa-42a0-8744-410dffd3dd89 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:22:35.803075 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-a620e278-2caa-42a0-8744-410dffd3dd89 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.409384 Sep 05 12:22:35.803075 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 19/39] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Sep 5 12:22:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 05 12:22:35.809400 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-78a04370-af71-4abf-a9ff-7d6ec46fc1ad admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:35.813581 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG dbcounter [-] [105953] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:35.832575 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-78a04370-af71-4abf-a9ff-7d6ec46fc1ad admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027187 Sep 05 12:22:35.833490 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 21/40] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Sep 5 12:22:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:22:35.843665 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-5e33e049-bcae-40a7-869e-cf0d9da6df06 admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:35.867400 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-5e33e049-bcae-40a7-869e-cf0d9da6df06 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027310 Sep 05 12:22:35.868199 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 20/41] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Sep 5 12:22:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:22:35.878975 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-ebaabca4-c2ae-4db8-912a-0eb1f4e91d46 admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:35.885585 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.wsgi [None req-ebaabca4-c2ae-4db8-912a-0eb1f4e91d46 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-ebaabca4-c2ae-4db8-912a-0eb1f4e91d46 admin admin] Request method failure captured: Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Accept: application/json Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Accept-Encoding: gzip, deflate Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Connection: keep-alive Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Content-Length: 0 Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Host: 10.222.0.62 Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Openstack-Api-Version: compute 2.92 Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Openstack-System-Scope: None Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: User-Agent: python-novaclient Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Auth-Token: gAAAAABjFeoLRZLBbOB2qa7_JLt2gtZyq48aDct9toqM6RXDOX3v6Hdtzpd5sW0Sk5bHd9TiHC9Gb64oxqaU1ZqlJGl71S2gh4cUQEzQTfWGihXVU_3F0dH5SDt87daZAqRdoUmf8N_SJnhbDzXVUQQ8-F8mDP4yuBFUChZeFMTaGfi8fGhDv3E Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Domain-Id: None Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Domain-Name: None Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Identity-Status: Confirmed Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Is-Admin-Project: True Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Project-Domain-Id: default Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Project-Domain-Name: Default Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Project-Id: d80f282fe9da41e0b08a14ba58840408 Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Project-Name: admin Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Role: member,admin,reader Sep 05 12:22:35.889504 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Roles: member,admin,reader Sep 05 12:22:35.901657 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:22:35.901657 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Tenant: admin Sep 05 12:22:35.901657 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Tenant-Id: d80f282fe9da41e0b08a14ba58840408 Sep 05 12:22:35.901657 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Tenant-Name: admin Sep 05 12:22:35.901657 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-User: admin Sep 05 12:22:35.901657 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-User-Domain-Id: default Sep 05 12:22:35.901657 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-User-Domain-Name: Default Sep 05 12:22:35.901657 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-User-Id: 57929111b78840da8ec77704273d56d2 Sep 05 12:22:35.901657 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-User-Name: admin Sep 05 12:22:35.901657 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: method: > Sep 05 12:22:35.901657 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: exception: Flavor 42 could not be found. Sep 05 12:22:35.901657 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: action_args: {'id': '42'} Sep 05 12:22:35.901657 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:22:35.901657 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:22:35.902660 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 12:22:35.902660 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 12:22:35.902660 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 12:22:35.902660 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 12:22:35.902660 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 12:22:35.902660 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 12:22:35.902660 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 12:22:35.902660 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 12:22:35.902660 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 12:22:35.902660 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:22:35.902660 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 12:22:35.902660 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 12:22:35.902660 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 05 12:22:35.902660 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Sep 05 12:22:35.902660 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:22:35.902660 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Sep 05 12:22:35.902660 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:22:35.902660 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:22:35.902660 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:22:35.903967 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:22:35.903967 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:22:35.903967 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:22:35.903967 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:22:35.903967 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 12:22:35.903967 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:22:35.903967 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 05 12:22:35.903967 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Sep 05 12:22:35.903967 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:22:35.903967 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Sep 05 12:22:35.903967 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:22:35.903967 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:22:35.903967 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:22:35.903967 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:22:35.903967 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:22:35.903967 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 05 12:22:35.903967 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Sep 05 12:22:35.903967 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-ebaabca4-c2ae-4db8-912a-0eb1f4e91d46 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:22:35.905196 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-ebaabca4-c2ae-4db8-912a-0eb1f4e91d46 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.016111 Sep 05 12:22:35.905196 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 22/42] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Sep 5 12:22:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 05 12:22:36.892770 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-5e33e049-bcae-40a7-869e-cf0d9da6df06 admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:36.893790 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-5e33e049-bcae-40a7-869e-cf0d9da6df06 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 05 12:22:36.894196 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 21/43] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Sep 5 12:22:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:22:37.443497 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-bdd42e29-eff8-4593-ac91-c1f98a298b6f admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:37.449779 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.wsgi [None req-bdd42e29-eff8-4593-ac91-c1f98a298b6f admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-bdd42e29-eff8-4593-ac91-c1f98a298b6f admin admin] Request method failure captured: Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Accept: application/json Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Accept-Encoding: gzip, deflate Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Connection: keep-alive Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Content-Length: 0 Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Host: 10.222.0.62 Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Openstack-Api-Version: compute 2.92 Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Openstack-System-Scope: None Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: User-Agent: python-novaclient Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Auth-Token: gAAAAABjFeoMxfE-MrVVM8x5OaeOon2nQvj2l6DkNajR3ezNhANjF0vAT4upUI4v6UWFXWU4igthaHMukTHPpMN_LRSTCIVX9Dno46drSLaCpC8ZMYbL6UQaUZR5_WUjxphK3R25KlDKt2EwJMaBJNEnDjjY0nY-C4JQpg8WbdaQBYSGsqyjnlM Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Domain-Id: None Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Domain-Name: None Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Identity-Status: Confirmed Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Is-Admin-Project: True Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Project-Domain-Id: default Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Project-Domain-Name: Default Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Project-Id: d80f282fe9da41e0b08a14ba58840408 Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Project-Name: admin Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Role: member,admin,reader Sep 05 12:22:37.451286 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Roles: member,admin,reader Sep 05 12:22:37.452949 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:22:37.452949 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Tenant: admin Sep 05 12:22:37.452949 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Tenant-Id: d80f282fe9da41e0b08a14ba58840408 Sep 05 12:22:37.452949 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Tenant-Name: admin Sep 05 12:22:37.452949 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-User: admin Sep 05 12:22:37.452949 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-User-Domain-Id: default Sep 05 12:22:37.452949 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-User-Domain-Name: Default Sep 05 12:22:37.452949 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-User-Id: 57929111b78840da8ec77704273d56d2 Sep 05 12:22:37.452949 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-User-Name: admin Sep 05 12:22:37.452949 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: method: > Sep 05 12:22:37.452949 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: exception: Flavor 84 could not be found. Sep 05 12:22:37.452949 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: action_args: {'id': '84'} Sep 05 12:22:37.452949 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:22:37.452949 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:22:37.453941 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 12:22:37.453941 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 12:22:37.453941 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 12:22:37.453941 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 12:22:37.453941 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 12:22:37.453941 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 12:22:37.453941 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 12:22:37.453941 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 12:22:37.453941 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 12:22:37.453941 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:22:37.453941 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 12:22:37.453941 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 12:22:37.453941 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 05 12:22:37.453941 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Sep 05 12:22:37.453941 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:22:37.453941 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Sep 05 12:22:37.453941 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:22:37.453941 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:22:37.453941 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:22:37.455474 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:22:37.455474 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:22:37.455474 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:22:37.455474 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:22:37.455474 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 12:22:37.455474 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:22:37.455474 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 05 12:22:37.455474 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Sep 05 12:22:37.455474 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:22:37.455474 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Sep 05 12:22:37.455474 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:22:37.455474 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:22:37.455474 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:22:37.455474 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:22:37.455474 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:22:37.455474 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 05 12:22:37.455474 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Sep 05 12:22:37.455474 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-bdd42e29-eff8-4593-ac91-c1f98a298b6f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:22:37.456769 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-bdd42e29-eff8-4593-ac91-c1f98a298b6f admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.419369 Sep 05 12:22:37.456769 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 23/44] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Sep 5 12:22:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 421 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 05 12:22:37.464907 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-3aff3bea-5add-4023-9669-167310066a33 admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:37.481495 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-3aff3bea-5add-4023-9669-167310066a33 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021554 Sep 05 12:22:37.486680 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 22/45] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Sep 5 12:22:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:22:37.492140 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-53599b01-cb66-4a72-af07-ce6fcf937005 admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:37.510240 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-53599b01-cb66-4a72-af07-ce6fcf937005 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021689 Sep 05 12:22:37.510798 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Sep 5 12:22:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:22:37.524678 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-d6386515-6080-466c-9c9d-333a611cdfd2 admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:37.530859 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.wsgi [None req-d6386515-6080-466c-9c9d-333a611cdfd2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-d6386515-6080-466c-9c9d-333a611cdfd2 admin admin] Request method failure captured: Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Accept: application/json Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Accept-Encoding: gzip, deflate Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Connection: keep-alive Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Content-Length: 0 Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Host: 10.222.0.62 Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Openstack-Api-Version: compute 2.92 Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Openstack-System-Scope: None Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: User-Agent: python-novaclient Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Auth-Token: gAAAAABjFeoMxfE-MrVVM8x5OaeOon2nQvj2l6DkNajR3ezNhANjF0vAT4upUI4v6UWFXWU4igthaHMukTHPpMN_LRSTCIVX9Dno46drSLaCpC8ZMYbL6UQaUZR5_WUjxphK3R25KlDKt2EwJMaBJNEnDjjY0nY-C4JQpg8WbdaQBYSGsqyjnlM Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Domain-Id: None Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Domain-Name: None Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Identity-Status: Confirmed Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Is-Admin-Project: True Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Project-Domain-Id: default Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Project-Domain-Name: Default Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Project-Id: d80f282fe9da41e0b08a14ba58840408 Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Project-Name: admin Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Role: member,admin,reader Sep 05 12:22:37.532420 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Roles: member,admin,reader Sep 05 12:22:37.533923 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:22:37.533923 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Tenant: admin Sep 05 12:22:37.533923 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Tenant-Id: d80f282fe9da41e0b08a14ba58840408 Sep 05 12:22:37.533923 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Tenant-Name: admin Sep 05 12:22:37.533923 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-User: admin Sep 05 12:22:37.533923 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-User-Domain-Id: default Sep 05 12:22:37.533923 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-User-Domain-Name: Default Sep 05 12:22:37.533923 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-User-Id: 57929111b78840da8ec77704273d56d2 Sep 05 12:22:37.533923 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-User-Name: admin Sep 05 12:22:37.533923 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: method: > Sep 05 12:22:37.533923 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: exception: Flavor 84 could not be found. Sep 05 12:22:37.533923 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: action_args: {'id': '84'} Sep 05 12:22:37.533923 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:22:37.533923 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:22:37.534696 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 12:22:37.534696 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 12:22:37.534696 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 12:22:37.534696 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 12:22:37.534696 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 12:22:37.534696 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 12:22:37.534696 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 12:22:37.534696 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 12:22:37.534696 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 12:22:37.534696 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:22:37.534696 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 12:22:37.534696 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 12:22:37.534696 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 05 12:22:37.534696 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Sep 05 12:22:37.534696 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:22:37.534696 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Sep 05 12:22:37.534696 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:22:37.534696 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:22:37.534696 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:22:37.536222 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:22:37.536222 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:22:37.536222 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:22:37.536222 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:22:37.536222 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 12:22:37.536222 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:22:37.536222 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 05 12:22:37.536222 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Sep 05 12:22:37.536222 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:22:37.536222 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Sep 05 12:22:37.536222 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:22:37.536222 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:22:37.536222 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:22:37.536222 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:22:37.536222 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:22:37.536222 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 05 12:22:37.536222 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Sep 05 12:22:37.536222 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-d6386515-6080-466c-9c9d-333a611cdfd2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:22:37.537464 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-d6386515-6080-466c-9c9d-333a611cdfd2 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012795 Sep 05 12:22:37.537464 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 23/47] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Sep 5 12:22:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 05 12:22:38.548114 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-53599b01-cb66-4a72-af07-ce6fcf937005 admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:38.549128 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-53599b01-cb66-4a72-af07-ce6fcf937005 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 05 12:22:38.549523 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 25/48] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Sep 5 12:22:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:22:39.112211 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-dcc175f9-b76e-4a9b-9258-7e00c4b2fd43 admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:39.118093 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.wsgi [None req-dcc175f9-b76e-4a9b-9258-7e00c4b2fd43 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-dcc175f9-b76e-4a9b-9258-7e00c4b2fd43 admin admin] Request method failure captured: Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Accept: application/json Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Accept-Encoding: gzip, deflate Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Connection: keep-alive Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Content-Length: 0 Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Host: 10.222.0.62 Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Openstack-Api-Version: compute 2.92 Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Openstack-System-Scope: None Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: User-Agent: python-novaclient Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Auth-Token: gAAAAABjFeoOEX-nrQBuxY5t4YUyKl6en9i8PiGV2ayfoAsqPr4XMEQ1u7CLE-Pbys6kjJG71zPH7wYbq2wOC3GAXol1W7zboJBWxFVADZ8IT0vI9qpPe1NIMKg_gEaiGIgZZw_TDuEjNXLTqb4VKn17k_Yzq2fqm2kfCwsRl7Kiufhj9Sba1Ac Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Domain-Id: None Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Domain-Name: None Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Identity-Status: Confirmed Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Is-Admin-Project: True Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Project-Domain-Id: default Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Project-Domain-Name: Default Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Project-Id: d80f282fe9da41e0b08a14ba58840408 Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Project-Name: admin Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Role: member,admin,reader Sep 05 12:22:39.119645 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Roles: member,admin,reader Sep 05 12:22:39.121704 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:22:39.121704 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Tenant: admin Sep 05 12:22:39.121704 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Tenant-Id: d80f282fe9da41e0b08a14ba58840408 Sep 05 12:22:39.121704 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-Tenant-Name: admin Sep 05 12:22:39.121704 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-User: admin Sep 05 12:22:39.121704 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-User-Domain-Id: default Sep 05 12:22:39.121704 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-User-Domain-Name: Default Sep 05 12:22:39.121704 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-User-Id: 57929111b78840da8ec77704273d56d2 Sep 05 12:22:39.121704 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: X-User-Name: admin Sep 05 12:22:39.121704 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: method: > Sep 05 12:22:39.121704 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: exception: Flavor 451 could not be found. Sep 05 12:22:39.121704 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: action_args: {'id': '451'} Sep 05 12:22:39.121704 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:22:39.121704 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:22:39.122703 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 12:22:39.122703 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 12:22:39.122703 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 12:22:39.122703 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 12:22:39.122703 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 12:22:39.122703 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 12:22:39.122703 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 12:22:39.122703 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 12:22:39.122703 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 12:22:39.122703 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:22:39.122703 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 12:22:39.122703 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 12:22:39.122703 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 05 12:22:39.122703 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Sep 05 12:22:39.122703 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:22:39.122703 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Sep 05 12:22:39.122703 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:22:39.122703 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:22:39.122703 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:22:39.124043 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:22:39.124043 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:22:39.124043 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:22:39.124043 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:22:39.124043 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 12:22:39.124043 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:22:39.124043 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 05 12:22:39.124043 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Sep 05 12:22:39.124043 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:22:39.124043 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Sep 05 12:22:39.124043 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:22:39.124043 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:22:39.124043 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:22:39.124043 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:22:39.124043 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:22:39.124043 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 05 12:22:39.124043 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: ERROR nova.api.openstack.wsgi Sep 05 12:22:39.124043 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-dcc175f9-b76e-4a9b-9258-7e00c4b2fd43 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:22:39.125267 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-dcc175f9-b76e-4a9b-9258-7e00c4b2fd43 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.431940 Sep 05 12:22:39.125267 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 24/49] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Sep 5 12:22:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 05 12:22:39.131432 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-43cfb3e2-6ad9-4d7b-b95c-43282cba4977 admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:39.146974 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-43cfb3e2-6ad9-4d7b-b95c-43282cba4977 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019126 Sep 05 12:22:39.147570 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 26/50] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Sep 5 12:22:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:22:39.157464 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-ea08c3ec-b2ff-4e61-a5ce-0393526da1e1 admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:39.173767 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-ea08c3ec-b2ff-4e61-a5ce-0393526da1e1 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019837 Sep 05 12:22:39.174302 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 25/51] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Sep 5 12:22:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:22:39.184828 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-babe233e-cacc-4678-bc3e-27ba4cba8aad admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:39.193813 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.wsgi [None req-babe233e-cacc-4678-bc3e-27ba4cba8aad admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-babe233e-cacc-4678-bc3e-27ba4cba8aad admin admin] Request method failure captured: Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Accept: application/json Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Accept-Encoding: gzip, deflate Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Connection: keep-alive Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Content-Length: 0 Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Host: 10.222.0.62 Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Openstack-Api-Version: compute 2.92 Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Openstack-System-Scope: None Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: User-Agent: python-novaclient Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Auth-Token: gAAAAABjFeoOEX-nrQBuxY5t4YUyKl6en9i8PiGV2ayfoAsqPr4XMEQ1u7CLE-Pbys6kjJG71zPH7wYbq2wOC3GAXol1W7zboJBWxFVADZ8IT0vI9qpPe1NIMKg_gEaiGIgZZw_TDuEjNXLTqb4VKn17k_Yzq2fqm2kfCwsRl7Kiufhj9Sba1Ac Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Domain-Id: None Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Domain-Name: None Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Identity-Status: Confirmed Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Is-Admin-Project: True Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Project-Domain-Id: default Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Project-Domain-Name: Default Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Project-Id: d80f282fe9da41e0b08a14ba58840408 Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Project-Name: admin Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Role: member,admin,reader Sep 05 12:22:39.195367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Roles: member,admin,reader Sep 05 12:22:39.197113 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d80f282fe9da41e0b08a14ba58840408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:22:39.197113 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Tenant: admin Sep 05 12:22:39.197113 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Tenant-Id: d80f282fe9da41e0b08a14ba58840408 Sep 05 12:22:39.197113 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-Tenant-Name: admin Sep 05 12:22:39.197113 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-User: admin Sep 05 12:22:39.197113 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-User-Domain-Id: default Sep 05 12:22:39.197113 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-User-Domain-Name: Default Sep 05 12:22:39.197113 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-User-Id: 57929111b78840da8ec77704273d56d2 Sep 05 12:22:39.197113 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: X-User-Name: admin Sep 05 12:22:39.197113 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: method: > Sep 05 12:22:39.197113 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: exception: Flavor 451 could not be found. Sep 05 12:22:39.197113 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: action_args: {'id': '451'} Sep 05 12:22:39.197113 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:22:39.197113 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:22:39.198138 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 12:22:39.198138 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 12:22:39.198138 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 12:22:39.198138 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 12:22:39.198138 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 12:22:39.198138 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 12:22:39.198138 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 12:22:39.198138 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 12:22:39.198138 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 12:22:39.198138 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:22:39.198138 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 12:22:39.198138 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 12:22:39.198138 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 05 12:22:39.198138 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Sep 05 12:22:39.198138 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:22:39.198138 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Sep 05 12:22:39.198138 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:22:39.198138 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:22:39.198138 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:22:39.199473 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:22:39.199473 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:22:39.199473 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:22:39.199473 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:22:39.199473 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 12:22:39.199473 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:22:39.199473 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 05 12:22:39.199473 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Sep 05 12:22:39.199473 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:22:39.199473 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Sep 05 12:22:39.199473 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:22:39.199473 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:22:39.199473 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:22:39.199473 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:22:39.199473 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:22:39.199473 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 05 12:22:39.199473 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: ERROR nova.api.openstack.wsgi Sep 05 12:22:39.199473 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-babe233e-cacc-4678-bc3e-27ba4cba8aad admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:22:39.200760 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-babe233e-cacc-4678-bc3e-27ba4cba8aad admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.016338 Sep 05 12:22:39.200760 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 27/52] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Sep 5 12:22:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 05 12:22:40.193452 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-ea08c3ec-b2ff-4e61-a5ce-0393526da1e1 admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:40.195105 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-ea08c3ec-b2ff-4e61-a5ce-0393526da1e1 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001884 Sep 05 12:22:40.195844 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 26/53] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Sep 5 12:22:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:22:40.754426 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-773cbdd4-5e99-49b7-ab0a-ff365d83decf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:40.838292 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-773cbdd4-5e99-49b7-ab0a-ff365d83decf admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.500779 Sep 05 12:22:40.838838 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 28/54] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Sep 5 12:22:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 12:22:41.836731 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-ea08c3ec-b2ff-4e61-a5ce-0393526da1e1 admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:41.837905 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-ea08c3ec-b2ff-4e61-a5ce-0393526da1e1 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Sep 05 12:22:41.838334 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 27/55] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Sep 5 12:22:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:22:42.404780 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-c85b8818-ab87-4c1d-ae54-f12274fd9c4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:42.504138 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-c85b8818-ab87-4c1d-ae54-f12274fd9c4e admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.517519 Sep 05 12:22:42.504904 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 29/56] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Sep 5 12:22:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:22:43.502433 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-ea08c3ec-b2ff-4e61-a5ce-0393526da1e1 admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:43.503446 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-ea08c3ec-b2ff-4e61-a5ce-0393526da1e1 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 05 12:22:43.503869 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 28/57] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Sep 5 12:22:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:22:44.078044 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-369a8657-aa77-4243-80c3-4240070e39a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:44.146328 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-369a8657-aa77-4243-80c3-4240070e39a5 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.502560 Sep 05 12:22:44.146884 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 30/58] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Sep 5 12:22:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:22:45.161689 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-ea08c3ec-b2ff-4e61-a5ce-0393526da1e1 admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:45.162703 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-ea08c3ec-b2ff-4e61-a5ce-0393526da1e1 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 05 12:22:45.163106 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 29/59] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Sep 5 12:22:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:22:45.711880 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-b0836add-8771-4f10-a70b-34003e03fe13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:22:45.803369 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-b0836add-8771-4f10-a70b-34003e03fe13 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.499300 Sep 05 12:22:45.803998 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 31/60] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Sep 5 12:22:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:22:46.804099 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-ea08c3ec-b2ff-4e61-a5ce-0393526da1e1 admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:46.805112 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-ea08c3ec-b2ff-4e61-a5ce-0393526da1e1 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 05 12:22:46.805543 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 30/61] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Sep 5 12:22:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:22:47.364240 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-3ca9708f-ed1a-4f04-a44d-34c8c5ea0c4d admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:22:47.386466 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-3ca9708f-ed1a-4f04-a44d-34c8c5ea0c4d admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.444526 Sep 05 12:22:47.387016 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 32/62] 10.222.0.62 () {60 vars in 1202 bytes} [Mon Sep 5 12:22:46 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:23:42.720874 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-ea08c3ec-b2ff-4e61-a5ce-0393526da1e1 admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:42.721813 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-ea08c3ec-b2ff-4e61-a5ce-0393526da1e1 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 05 12:23:42.722482 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 31/63] 10.222.0.62 () {54 vars in 931 bytes} [Mon Sep 5 12:23:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:23:42.734837 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG dbcounter [-] [105953] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:43.184367 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-fa34d15c-2c0f-4c14-b736-7a36b108844f admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:43.206467 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-fa34d15c-2c0f-4c14-b736-7a36b108844f admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.476369 Sep 05 12:23:43.207071 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 33/64] 10.222.0.62 () {60 vars in 1292 bytes} [Mon Sep 5 12:23:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:23:43.230039 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG dbcounter [-] [105952] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:43.233894 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-afa56f5d-77b2-4054-8d87-5bfbc1916bb3 admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:43.241841 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-afa56f5d-77b2-4054-8d87-5bfbc1916bb3 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013333 Sep 05 12:23:43.244233 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 32/65] 10.222.0.62 () {60 vars in 1283 bytes} [Mon Sep 5 12:23:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:43.255352 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-db877c1f-346e-4bf9-b13a-653ad4dbc431 admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:43.264786 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-db877c1f-346e-4bf9-b13a-653ad4dbc431 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013052 Sep 05 12:23:43.265357 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 34/66] 10.222.0.62 () {60 vars in 1286 bytes} [Mon Sep 5 12:23:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:43.283849 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-455aba9b-f058-471a-9374-2f28be1acadc admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:43.295380 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-455aba9b-f058-471a-9374-2f28be1acadc admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017459 Sep 05 12:23:43.301012 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 33/67] 10.222.0.62 () {60 vars in 1286 bytes} [Mon Sep 5 12:23:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:23:43.313159 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-7e757321-9629-4021-9db7-40c3d82d7696 admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:23:43.321661 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-7e757321-9629-4021-9db7-40c3d82d7696 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012765 Sep 05 12:23:43.322747 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 35/68] 10.222.0.62 () {60 vars in 1283 bytes} [Mon Sep 5 12:23:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:27:12.255550 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-455aba9b-f058-471a-9374-2f28be1acadc admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:12.256569 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-455aba9b-f058-471a-9374-2f28be1acadc admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 05 12:27:12.256996 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 34/69] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Sep 5 12:27:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:27:12.399206 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG dbcounter [-] [105953] Writing DB stats nova_api:SELECT=6 {{(pid=105953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:12.566402 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-05c59c1c-cde8-44cf-a60b-11ce924f926a admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:12.569808 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-05c59c1c-cde8-44cf-a60b-11ce924f926a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:12.570285 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-05c59c1c-cde8-44cf-a60b-11ce924f926a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:12.570733 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-05c59c1c-cde8-44cf-a60b-11ce924f926a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:12.571449 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-05c59c1c-cde8-44cf-a60b-11ce924f926a admin admin] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:12.571924 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-05c59c1c-cde8-44cf-a60b-11ce924f926a admin admin] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:12.572344 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-05c59c1c-cde8-44cf-a60b-11ce924f926a admin admin] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:12.607095 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-05c59c1c-cde8-44cf-a60b-11ce924f926a admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.209298 Sep 05 12:27:12.607685 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 36/70] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Sep 5 12:27:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 12:27:13.439009 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-455aba9b-f058-471a-9374-2f28be1acadc admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:13.440051 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-455aba9b-f058-471a-9374-2f28be1acadc admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 05 12:27:13.440446 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 35/71] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Sep 5 12:27:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:27:13.630884 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-f2c6ad52-4fe9-49b8-91da-9ab45aa57123 admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:13.634337 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-f2c6ad52-4fe9-49b8-91da-9ab45aa57123 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:13.634808 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-f2c6ad52-4fe9-49b8-91da-9ab45aa57123 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:13.635238 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-f2c6ad52-4fe9-49b8-91da-9ab45aa57123 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:13.635984 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-f2c6ad52-4fe9-49b8-91da-9ab45aa57123 admin admin] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:13.636421 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-f2c6ad52-4fe9-49b8-91da-9ab45aa57123 admin admin] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:13.636833 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-f2c6ad52-4fe9-49b8-91da-9ab45aa57123 admin admin] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:13.656568 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-f2c6ad52-4fe9-49b8-91da-9ab45aa57123 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.078121 Sep 05 12:27:13.657053 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 37/72] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Sep 5 12:27:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:27:24.907909 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-455aba9b-f058-471a-9374-2f28be1acadc admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:24.908972 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-455aba9b-f058-471a-9374-2f28be1acadc admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Sep 05 12:27:24.915971 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 36/73] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Sep 5 12:27:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:27:25.053761 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG dbcounter [-] [105953] Writing DB stats nova_cell0:SELECT=4 {{(pid=105953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:25.054519 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG dbcounter [-] [105953] Writing DB stats nova_cell1:SELECT=4 {{(pid=105953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:25.055130 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG dbcounter [-] [105953] Writing DB stats nova_api:SELECT=8 {{(pid=105953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:25.105062 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-7a826697-d366-44e9-9607-2cf8a481f766 admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:25.108981 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-7a826697-d366-44e9-9607-2cf8a481f766 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:25.112127 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-7a826697-d366-44e9-9607-2cf8a481f766 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:25.112127 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-7a826697-d366-44e9-9607-2cf8a481f766 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:25.112127 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-7a826697-d366-44e9-9607-2cf8a481f766 admin admin] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:25.112127 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-7a826697-d366-44e9-9607-2cf8a481f766 admin admin] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:25.112514 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-7a826697-d366-44e9-9607-2cf8a481f766 admin admin] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:25.138110 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-7a826697-d366-44e9-9607-2cf8a481f766 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.088762 Sep 05 12:27:25.138654 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 38/74] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Sep 5 12:27:25 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:27:25.963333 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: DEBUG nova.api.openstack.wsgi [None req-455aba9b-f058-471a-9374-2f28be1acadc admin admin] Calling method '>' {{(pid=105952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:25.964405 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: INFO nova.api.openstack.requestlog [None req-455aba9b-f058-471a-9374-2f28be1acadc admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Sep 05 12:27:25.964800 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: [pid: 105952|app: 0|req: 37/75] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Sep 5 12:27:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:27:26.157529 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG nova.api.openstack.wsgi [None req-a8f44d49-34de-44f4-90da-52a46c2a270e admin admin] Calling method '>' {{(pid=105953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:27:26.161050 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-a8f44d49-34de-44f4-90da-52a46c2a270e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:26.161515 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-a8f44d49-34de-44f4-90da-52a46c2a270e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:26.161968 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-a8f44d49-34de-44f4-90da-52a46c2a270e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:26.162701 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-a8f44d49-34de-44f4-90da-52a46c2a270e admin admin] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:27:26.163142 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-a8f44d49-34de-44f4-90da-52a46c2a270e admin admin] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:27:26.163565 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: DEBUG oslo_concurrency.lockutils [None req-a8f44d49-34de-44f4-90da-52a46c2a270e admin admin] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:27:26.184743 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: INFO nova.api.openstack.requestlog [None req-a8f44d49-34de-44f4-90da-52a46c2a270e admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.079569 Sep 05 12:27:26.185227 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: [pid: 105953|app: 0|req: 39/76] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Sep 5 12:27:26 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:28:23.897124 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: Mon Sep 5 12:28:23 2022 - graceful shutdown triggered... Sep 05 12:28:23.897421 dv-cinder-801354-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 05 12:28:23.898213 dv-cinder-801354-7-iscsi devstack@n-api.service[105952]: Gracefully killing worker 1 (pid: 105952)... Sep 05 12:28:23.898608 dv-cinder-801354-7-iscsi devstack@n-api.service[105953]: Gracefully killing worker 2 (pid: 105953)... Sep 05 12:28:24.898379 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: worker 1 buried after 1 seconds Sep 05 12:28:24.898849 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: worker 2 buried after 1 seconds Sep 05 12:28:24.898849 dv-cinder-801354-7-iscsi devstack@n-api.service[105951]: goodbye to uWSGI. Sep 05 12:28:24.900045 dv-cinder-801354-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 05 12:28:24.900893 dv-cinder-801354-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 05 12:28:24.904002 dv-cinder-801354-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 05 12:28:24.914009 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 05 12:28:24.915929 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 5 12:28:24 2022] *** Sep 05 12:28:24.915929 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 05 12:28:24.915929 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 05 12:28:24.915929 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: nodename: dv-cinder-801354-7-iscsi Sep 05 12:28:24.915929 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: machine: x86_64 Sep 05 12:28:24.915929 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: clock source: unix Sep 05 12:28:24.915929 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: pcre jit disabled Sep 05 12:28:24.915929 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: detected number of CPU cores: 4 Sep 05 12:28:24.915929 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: current working directory: / Sep 05 12:28:24.915929 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: detected binary path: /usr/bin/uwsgi-core Sep 05 12:28:24.915929 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: your processes number limit is 47680 Sep 05 12:28:24.915929 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: your memory page size is 4096 bytes Sep 05 12:28:24.915929 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: detected max file descriptor number: 2048 Sep 05 12:28:24.915929 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: lock engine: pthread robust mutexes Sep 05 12:28:24.916815 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: thunder lock: enabled Sep 05 12:28:24.916815 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 05 12:28:24.916815 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 05 12:28:24.956034 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: Python main interpreter initialized at 0x5623518f29c0 Sep 05 12:28:24.956034 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: python threads support enabled Sep 05 12:28:24.956034 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: your server socket listen backlog is limited to 100 connections Sep 05 12:28:24.956034 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: your mercy for graceful operations on workers is 90 seconds Sep 05 12:28:24.956896 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: mapped 403077 bytes (393 KB) for 2 cores Sep 05 12:28:24.956896 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: *** Operational MODE: preforking *** Sep 05 12:28:24.957138 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: *** uWSGI is running in multiple interpreter mode *** Sep 05 12:28:24.957138 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: spawned uWSGI master process (pid: 121198) Sep 05 12:28:24.957172 dv-cinder-801354-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 05 12:28:24.957796 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: spawned uWSGI worker 1 (pid: 121210, cores: 1) Sep 05 12:28:24.958609 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: spawned uWSGI worker 2 (pid: 121211, cores: 1) Sep 05 12:28:24.958766 dv-cinder-801354-7-iscsi devstack@n-api.service[121198]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 05 12:28:25.645170 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 05 12:28:25.645803 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 05 12:28:26.828680 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:28:26.828680 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: from cryptography.utils import int_from_bytes Sep 05 12:28:26.829634 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:28:26.829634 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: from cryptography.utils import int_from_bytes Sep 05 12:28:26.850402 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:28:26.850402 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: from cryptography.utils import int_from_bytes Sep 05 12:28:26.851343 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:28:26.851343 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: from cryptography.utils import int_from_bytes Sep 05 12:28:29.488174 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 12:28:29.488797 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 12:28:29.489395 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 12:28:29.489969 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 12:28:29.490362 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 12:28:29.490957 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.491474 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.492015 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.492532 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.493064 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.493571 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.493753 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 12:28:29.494176 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 12:28:29.494298 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.494685 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 12:28:29.494781 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.494990 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 12:28:29.495150 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.495250 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 12:28:29.495528 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.495661 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.495874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.496081 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.496191 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.496500 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.496798 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801354-7-iscsi {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.496914 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.497126 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.497337 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.497446 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.497747 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.497852 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.498070 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.498297 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.498408 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.498630 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.498813 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.499095 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801354-7-iscsi {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.499305 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.499409 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.499741 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.499940 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.500098 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.500354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.500541 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.500696 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.500967 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.501228 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.501415 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.501780 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.502087 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.502387 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.502693 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.503047 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.503339 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.503667 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.503892 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.504111 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.504315 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.504528 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.504743 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.504958 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.505191 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.505404 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.505613 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801354-7-iscsi {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.505613 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.506065 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.506277 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.506277 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.506679 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.506906 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.507126 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.507336 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.507336 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.507783 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.508011 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.508011 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.508390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.508573 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.508785 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.508942 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.508942 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.509268 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801354-7-iscsi {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.509414 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.509414 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.509698 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.509896 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.509896 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.510454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.510615 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.510768 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.510911 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.510911 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.511246 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.512368 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.512529 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.512529 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.512817 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.512961 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.513117 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.513277 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.513277 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.513558 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.513710 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.513710 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.514075 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.514230 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.514230 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.514516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.514658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.514814 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.514975 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.514975 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.515262 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.515419 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.515419 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.515760 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.515913 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.515913 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.516195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.516348 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.516499 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.516652 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.516652 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.516946 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.517090 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.517239 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.517389 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.517584 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.517745 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.517889 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.518040 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.518192 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.518423 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.518649 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.518813 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.518979 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.519129 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.519278 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.519588 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.519747 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.519900 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.520091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.520252 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.520474 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.521151 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.521302 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.521618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.522534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.522711 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.522875 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.523027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.523176 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.523331 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.523331 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.523657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.523804 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.523804 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.524090 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.524235 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.524235 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.524540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.524690 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.524839 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.524990 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.524990 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.525267 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.525420 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.525420 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.525873 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.526025 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.526174 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.526324 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.526480 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.526633 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.526776 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.526927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.527078 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.527285 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.527435 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.527656 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.527916 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.528065 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.528217 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.528437 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.528596 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.528820 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.528968 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.529125 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.529419 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.529567 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.529728 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.529959 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.530123 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.530328 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.530609 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.530765 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.530941 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.531091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.531258 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.531506 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.531732 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.531905 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.532777 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.532924 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.532924 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.533215 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.533369 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.533369 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.533644 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.533801 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.533801 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.534090 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.534242 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.534392 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.534537 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.534537 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.534827 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.534977 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.535127 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.535277 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.535427 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.535661 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.535819 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.535963 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.536244 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.536898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.537125 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.537282 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.537432 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.537855 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.538022 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.538179 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.538335 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.538480 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.538630 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.538773 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.538979 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.539129 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.539320 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.539655 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.539835 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.540080 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.540234 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.540411 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.540654 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.540806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.541027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.541379 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.541542 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.541704 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.541859 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.542009 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.542653 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.542980 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.542980 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.543302 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.543446 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.543615 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.543774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.543774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.544052 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.544771 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.544882 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.544974 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.545063 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.545138 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.545210 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.545299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.545466 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.545559 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.545761 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.546041 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.546153 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.546364 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.546533 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.546703 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.547058 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.547158 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.547371 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.547605 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.547705 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.548035 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.548151 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.548348 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.548599 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.548705 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.548956 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.549138 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.549306 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.549601 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.549707 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.549919 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.550122 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.550235 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.550539 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.550650 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.550859 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.551111 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.551209 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.551468 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.551687 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.551870 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.552148 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.552253 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.552459 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.552698 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.552850 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.553093 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.553251 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.553399 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.553694 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.553848 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.554007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.554206 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.554368 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.554610 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.554761 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.554920 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.555207 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.555367 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.555521 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.555752 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.555905 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.556277 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.556440 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.556587 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.556742 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.556886 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.557132 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.557305 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.557461 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.557743 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.557897 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.558072 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.558292 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.558461 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.558664 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.558824 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.558980 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.559228 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.559381 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.559563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.559775 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.559927 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.560546 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.560715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.560879 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.561035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.561182 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.561182 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.561454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.561609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.561769 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.561922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.562067 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.562265 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.562417 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.562568 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.562767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.562930 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.563170 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.563329 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.563474 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.563820 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.564000 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:28:29.564164 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.564438 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.565373 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.565373 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.565682 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.565836 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.565836 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.566128 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.566279 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.566279 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.566568 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.566724 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.566868 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.567036 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.567036 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.568130 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.568304 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.568304 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.568683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.568841 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.568841 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.569132 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.569289 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.569435 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.569591 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.569591 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.569870 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.570030 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.570177 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.570320 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.570463 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.570656 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.570815 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.570977 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.571159 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.571328 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.571553 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.571719 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.571875 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.572186 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.572348 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.572648 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.572834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.572982 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.573297 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.573457 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.573632 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.573824 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.573976 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.574261 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.574427 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.574574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.574854 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.575006 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.575179 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.575386 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.575596 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.575817 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.575967 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.576123 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.576440 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.576591 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.576759 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.576996 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.577157 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.577367 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.577561 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.577726 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.577984 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.578144 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.578291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.578587 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.578753 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.578914 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.579202 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.579375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.579522 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.579903 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.580121 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.580319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.580500 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.580681 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.580862 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.581040 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.581211 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.581369 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.581514 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.581670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.581917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.582071 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.582216 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.582443 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.582595 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.582822 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.582972 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.583274 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.583518 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.583692 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.583851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.584091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.584243 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.584445 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.584611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.584769 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.585084 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.585244 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.585390 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.585627 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.585790 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.585991 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.586148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.586293 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.586594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.586762 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.586985 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.587139 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.587292 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.587481 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.587734 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.587902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.588332 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.588503 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.588668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.588895 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.589055 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.589215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.589387 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.589544 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.589812 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.589974 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.590121 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.590341 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.590495 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.590710 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.590883 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.591035 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.591415 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.591648 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.591834 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.592035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.592218 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.592398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.592587 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.592768 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.592949 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.593136 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.593318 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.593498 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.593692 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.593874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.594061 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.594253 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.594445 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.594632 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.594828 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.595017 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.595206 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.595395 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.595633 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.595798 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.595954 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.596106 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.596251 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.596454 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.596605 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.596779 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.597244 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.597413 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.597617 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.597817 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.597981 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.598250 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.598434 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.599199 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.599421 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.599609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.599769 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.600566 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.600726 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.600726 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.601015 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.601159 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.601311 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.601483 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.601483 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.601884 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.602036 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.602036 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.602326 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.602479 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.602626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.602784 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.602937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.603082 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.603351 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.603511 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.603731 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.604014 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.604176 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.604422 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.604583 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.604749 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.605045 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.605205 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.605358 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.605576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.605739 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.605936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.606119 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.606271 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.606531 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.606692 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.606852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.607127 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.607295 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.607448 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.607720 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.607891 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.608045 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.608245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.608442 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.608628 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.608912 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.609073 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.609219 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.609369 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.609619 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.609782 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.609937 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.610091 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.610275 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.610428 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.610706 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.610858 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.611004 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.611301 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.611460 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.611651 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.611920 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.612082 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.612244 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.612390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.612568 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.612827 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.613086 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.613240 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.613399 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.613551 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.613798 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.613958 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.614113 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.614949 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.615131 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.615278 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.615495 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.615687 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.615876 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.616027 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.616181 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.616466 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.616629 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.616775 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.617033 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.617209 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.617371 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.617510 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.617674 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.617955 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.618108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.618266 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.618486 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.618635 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.618850 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.618993 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.619153 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.619462 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.619751 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.619895 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.620047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.620187 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.620475 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.620629 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.620773 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.621027 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.621178 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.621363 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.621584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.621735 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.621966 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.622104 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.622265 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.622556 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.622713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.622854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.623122 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.623271 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.623436 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.623691 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.623844 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.624080 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.624222 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.624370 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.624669 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.624834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.624985 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.625218 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.625370 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.625549 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.625745 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.625898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.626158 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.626300 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.626462 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.626744 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.626886 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.627043 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.627271 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.627414 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.627646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.627834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.627985 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.628241 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.628389 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.628558 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.628826 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.628969 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.629116 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.629349 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.629490 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.629698 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.629934 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.630082 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.630342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.630486 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.630646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.630882 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.631027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.631245 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.631426 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.631590 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.631900 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.632043 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.632259 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.632565 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.632715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.632864 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.633110 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.633253 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.633475 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.633659 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.633816 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.634081 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.634289 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.634431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.634611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.634764 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.635075 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.635242 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.635383 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.635637 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.635785 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.635961 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.636156 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.636308 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.636596 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.636769 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.636877 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.637160 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.637277 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.637497 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.637657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.637817 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.638117 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.638220 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.638423 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.638668 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.638767 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.639020 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.639178 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.639328 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.639656 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.639815 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.639955 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.640230 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.640421 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.640604 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.640716 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.640931 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.641806 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.641934 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.641934 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.642120 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.642333 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.642620 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.642935 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.643242 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.643587 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.643898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.644061 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.644210 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.644385 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.644548 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.644741 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.644891 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.645079 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.645264 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.645524 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.645692 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.645845 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.645996 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.646140 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.646289 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.646424 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.646691 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.646905 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.647035 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.647299 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.647428 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.647585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.647719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.647898 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.648029 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.648216 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.648369 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.648553 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.648655 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.648854 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.648935 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.649172 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.649254 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.649582 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.649700 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.649811 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.650157 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.650284 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.650419 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.650628 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.650858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.650962 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.651187 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.651310 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.651491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.651729 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.651820 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.651991 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.652093 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.652318 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.652497 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.652741 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.652894 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.653023 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.653144 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.653413 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.653572 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.653699 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.653813 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.653934 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.654064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.654399 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.654714 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.655025 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.655344 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.655691 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.656019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.656329 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.656640 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.656950 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.657335 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.657592 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.657904 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.658119 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.658354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.658560 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.658763 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.658969 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.659178 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.659401 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.659635 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.659858 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.660077 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.660077 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.660466 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.660695 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.660925 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.661638 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.661849 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.662065 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.662294 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.662602 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.662808 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.662998 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.663189 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.663370 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.663614 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.663830 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.664025 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.664215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.664397 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.664592 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.664793 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.664984 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.665164 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.665370 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.665560 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.665750 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.665954 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.666160 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.666348 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.666534 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.666727 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.666919 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.667120 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.667320 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.667320 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.667740 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.667928 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.668122 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.668316 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.668316 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.668679 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.668860 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.669038 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.669261 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.669456 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.669646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.669837 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.670024 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.670208 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.670403 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.670403 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.670870 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.671052 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.671255 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.671434 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.671727 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.671925 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.672108 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.672306 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.672493 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.672679 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.672861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.673040 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.673241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.673429 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.673609 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.673810 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.674019 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.674213 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.674394 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.674608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.674791 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.674973 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.675175 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.675364 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.675577 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.675788 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.675984 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.676168 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.676372 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.676555 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.676773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.677501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.677689 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.677869 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.678070 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.678252 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.678455 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.678655 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.678847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.679028 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.679230 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.679431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.679698 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.679898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.680083 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.680275 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.680454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.680657 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.680860 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.681067 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.681257 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.681454 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.681656 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.681865 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.682073 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.682257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.682257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.682614 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.682795 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.682994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.683198 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.683383 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.683627 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.683814 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.684010 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.684222 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.684409 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.684588 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.684783 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.684980 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.685172 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.685365 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.685557 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.685761 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.685953 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.686134 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.686326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.686517 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.686711 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.686894 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.687083 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.687083 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.687470 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.687470 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.687930 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.688112 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.688313 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.688313 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.688704 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.688704 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.689082 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.689277 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.689470 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.689680 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.689904 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.690104 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.690305 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.690514 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.690710 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.690915 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.691108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.691299 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.691505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.691738 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.691943 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.692151 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.692353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.692574 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.692779 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.692974 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.693165 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.693372 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.693568 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.693769 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.693964 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.694179 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.694386 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.694588 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.694790 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.695000 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.695210 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.695422 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.695422 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.695842 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.696053 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.696258 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.696468 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.696672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.696871 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.697071 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.697274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.697483 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.697791 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.698015 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.698225 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.698423 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.698627 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.698827 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.699046 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.699248 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.699439 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.699660 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.699853 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.700068 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.700265 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.700464 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.700673 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.700868 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.700868 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.701278 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.701474 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.701680 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.701886 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.702081 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.702276 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.702489 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.702690 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.702884 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.703080 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.703278 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.703473 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.703684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.703684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.704057 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.704254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.704454 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.704658 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.704861 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.705056 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.705264 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.705453 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.705638 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.705838 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.706034 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.706226 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.706419 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.706623 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.706807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.707017 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.707217 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.707399 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.707639 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.707831 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.708066 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.708255 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.708255 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.708609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.708792 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.708995 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.709189 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.709381 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.709566 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.709747 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.709938 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.710123 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.710326 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.710524 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.710719 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.710905 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.710905 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.711250 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.711456 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.711730 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.711936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.712127 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.712330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.712534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.712734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.712930 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.713115 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.713319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.713319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.713701 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.713897 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.714115 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.714313 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.714496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.714695 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.714893 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.715079 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.715282 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.715478 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.715667 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.715773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.715974 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.716089 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.716187 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.716275 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.716361 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.716454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.716541 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.716646 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.716733 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.716818 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.716911 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.717007 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.717101 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.717198 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.717291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.717384 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.717477 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.717572 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.717671 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.717758 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.717843 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.717945 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.718045 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.718144 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.718238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.718358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.718444 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.718536 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.718630 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.718722 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.718814 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.718909 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.719001 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.719086 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.719179 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.719311 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.719414 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.719522 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.719637 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.719637 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.719798 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.719885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.719970 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.720060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.720145 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.720237 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.720334 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.720334 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.720501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.720592 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.720677 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.720789 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.720873 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.720953 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.721038 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.721122 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.721213 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.721213 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.721388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.721388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.721565 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.721652 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.721747 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.721840 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.722187 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.722276 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.722367 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.722458 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.722553 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.722647 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.722739 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.722831 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.722922 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.723007 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.723099 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.723190 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.724751 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.724849 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.724931 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.725024 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.725024 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.725197 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.725288 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.725380 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.725472 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.725564 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.725658 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.725744 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.725829 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.725920 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.726013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.726106 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.726274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.726370 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.726456 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.726541 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.726541 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.726699 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.726793 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.726886 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.726977 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.727069 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.727155 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.727252 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.727339 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.727423 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.727507 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.727610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.727712 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.727807 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.727908 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.727993 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.728082 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.728162 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.728242 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.728343 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.728429 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.728509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.728603 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.728747 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.728877 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.728968 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.729067 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.729154 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.729245 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.729380 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.729487 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.729582 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.729667 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.729755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.729843 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.729924 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.730012 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.730104 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.730191 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.730276 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.730360 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.730457 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.730543 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.731314 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.731408 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.731498 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.731601 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.731698 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.731792 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.731878 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.731970 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.732055 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.732139 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.732238 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.732329 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.732421 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.732507 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.732598 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.732690 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.732783 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.732869 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.732953 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.733043 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.733129 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.733221 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.733313 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.733643 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.733743 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.733828 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.733912 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.734013 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.734107 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.734193 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.734277 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.734378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.734452 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.734544 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.734638 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.734724 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.734807 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.734897 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.734991 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.734991 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.735155 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.735248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.735339 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.735436 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.735551 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.735551 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.735724 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.735818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.735911 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.736002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.736100 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.736187 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.736270 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.736360 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.736445 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.736536 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.736628 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.736714 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.736797 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.736882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.736965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.737061 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.737152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.737244 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.737329 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.737413 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.737496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.737586 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.737671 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.737763 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.737854 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.737935 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.738020 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.738116 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.738245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.738347 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.738422 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.738501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.738573 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.738664 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.738737 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.738809 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.738951 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.739045 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.739138 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.739232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.739922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.740016 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.740103 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.740185 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.740267 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.740341 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.740568 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.740670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.740894 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.740995 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.741203 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.741304 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.741511 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.741604 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.741822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.741924 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.742130 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.742232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.742449 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.742540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.742759 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.742866 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.743079 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.743173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.743392 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.743494 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.743835 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.743938 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.744032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.744125 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.744362 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.744483 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.744742 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.744847 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.745063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.745155 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.745375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.745467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.745684 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.745786 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.745993 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.746088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.746305 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.746396 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.746625 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.746727 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.746943 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.747036 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.747263 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.747366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.747667 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.747864 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.748024 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.748297 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.748473 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.748596 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.748749 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.748881 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.749006 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.749121 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.749235 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.749425 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.749527 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.749739 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.749831 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.750054 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.750138 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.750371 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.750462 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.750680 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.750779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.750992 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.751084 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.751301 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.751394 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.751633 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.751728 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.751958 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.752066 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.752272 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.752373 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.752597 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.752691 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.752921 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.753023 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.753230 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.753322 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.753544 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.753635 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.753937 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.754042 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.754198 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.754294 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.754505 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.754593 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.754839 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.754934 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.755163 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.755258 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.755477 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.755591 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.755816 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.755911 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.756119 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.756213 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.756360 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 12:28:29.756454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.756741 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.757054 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.757367 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.757685 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.757999 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.758327 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.758662 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.758985 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.759300 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.759639 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.759964 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.760496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.760815 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.761152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.761480 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.761814 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.762133 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.762452 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.762783 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.763093 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.763401 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.763747 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.764070 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.764378 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.764731 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.765045 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.765356 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.765679 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.765986 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.766527 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.766878 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.767200 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.767530 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.767881 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.768205 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.768515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.768842 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.769154 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.769461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.769778 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.770093 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.770400 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.770734 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.771049 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.771361 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.771985 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.772110 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.772320 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.772649 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.772959 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.773267 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.773575 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.773918 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.774286 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.774526 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.774832 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.775149 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.775459 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.775855 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.776268 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.776581 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.776893 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.777269 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.777584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.777896 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.778222 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.778534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.778839 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.779159 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.779472 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.779827 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.780140 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.780457 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.780806 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.781125 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.781736 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.782018 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.782337 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.782674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.783009 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.783320 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.783656 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.783963 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.784314 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.784601 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.784917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.785232 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.785545 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.785858 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.786687 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.787004 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.787316 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.787679 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.787998 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.788310 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.788625 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.788939 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.789250 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.789568 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.789913 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.790236 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.790558 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.790880 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.791200 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.791603 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.791947 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.792188 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.792510 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.792833 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.793165 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.793484 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.793796 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.794227 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.794588 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.794857 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.795181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.795495 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.795846 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.796176 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.796517 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.796843 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.797158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.797487 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.797830 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.798162 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.798520 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.798790 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.799097 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.799405 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.799748 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.800069 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.800490 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.800752 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.801064 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.801380 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.801686 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.802600 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.802913 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.803223 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.803573 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.803867 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.804177 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.804651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.804808 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.805091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.805380 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.805692 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.806002 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.806305 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.806612 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.806933 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.807280 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.807643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.807986 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.808303 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.808631 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.808949 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.809275 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.809587 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.809910 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.810237 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.810590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.810866 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.811202 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.811516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.811859 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.812172 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.812491 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.812805 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.813118 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.813452 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.813784 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.814092 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.814435 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.814733 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.815052 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.815371 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.815720 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.816057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.816369 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.816684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.817001 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.817311 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.817654 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.817886 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO dbcounter [None req-58c90312-0773-432f-9c97-62826a171175 None None] Registered counter for database nova_api Sep 05 12:28:29.818118 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.818342 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.818561 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.818889 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.819207 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.819564 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.819890 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.820217 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.820698 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.820951 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.821254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.821577 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.821969 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.822305 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.822672 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.822993 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.823302 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:28:29.823573 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 12:28:29.838646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_db.sqlalchemy.engines [None req-58c90312-0773-432f-9c97-62826a171175 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:28:29.845324 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writer thread running {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:28:29.886233 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO dbcounter [None req-6372a584-4292-4434-a2bd-6c1a17afad80 None None] Registered counter for database nova_api Sep 05 12:28:29.902346 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.context [None req-58c90312-0773-432f-9c97-62826a171175 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),81343397-9614-45e8-9ed8-cbb978677508(cell1) {{(pid=121210) load_cells /opt/stack/nova/nova/context.py:464}} Sep 05 12:28:29.906526 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-58c90312-0773-432f-9c97-62826a171175 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:29.906775 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_db.sqlalchemy.engines [None req-6372a584-4292-4434-a2bd-6c1a17afad80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121211) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:28:29.907221 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-58c90312-0773-432f-9c97-62826a171175 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:29.908402 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-58c90312-0773-432f-9c97-62826a171175 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:29.909146 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-58c90312-0773-432f-9c97-62826a171175 None None] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:29.909588 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-58c90312-0773-432f-9c97-62826a171175 None None] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:29.912127 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-58c90312-0773-432f-9c97-62826a171175 None None] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:29.914053 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writer thread running {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:28:29.914230 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO dbcounter [None req-58c90312-0773-432f-9c97-62826a171175 None None] Registered counter for database nova_cell0 Sep 05 12:28:29.918258 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO dbcounter [None req-58c90312-0773-432f-9c97-62826a171175 None None] Registered counter for database nova_cell1 Sep 05 12:28:29.928357 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_db.sqlalchemy.engines [None req-58c90312-0773-432f-9c97-62826a171175 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:28:29.931163 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_db.sqlalchemy.engines [None req-58c90312-0773-432f-9c97-62826a171175 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:28:29.938305 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writer thread running {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:28:29.939611 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writer thread running {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:28:29.972180 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.context [None req-6372a584-4292-4434-a2bd-6c1a17afad80 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),81343397-9614-45e8-9ed8-cbb978677508(cell1) {{(pid=121211) load_cells /opt/stack/nova/nova/context.py:464}} Sep 05 12:28:29.976814 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6372a584-4292-4434-a2bd-6c1a17afad80 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:29.977368 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6372a584-4292-4434-a2bd-6c1a17afad80 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:29.978949 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6372a584-4292-4434-a2bd-6c1a17afad80 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:29.979784 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6372a584-4292-4434-a2bd-6c1a17afad80 None None] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:28:29.980236 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6372a584-4292-4434-a2bd-6c1a17afad80 None None] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:28:29.982257 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6372a584-4292-4434-a2bd-6c1a17afad80 None None] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:28:29.984311 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO dbcounter [None req-6372a584-4292-4434-a2bd-6c1a17afad80 None None] Registered counter for database nova_cell0 Sep 05 12:28:29.988570 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO dbcounter [None req-6372a584-4292-4434-a2bd-6c1a17afad80 None None] Registered counter for database nova_cell1 Sep 05 12:28:29.996786 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_db.sqlalchemy.engines [None req-6372a584-4292-4434-a2bd-6c1a17afad80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121211) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:28:30.000047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_db.sqlalchemy.engines [None req-6372a584-4292-4434-a2bd-6c1a17afad80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121211) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:28:30.005398 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writer thread running {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:28:30.095797 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO dbcounter [None req-58c90312-0773-432f-9c97-62826a171175 None None] Registered counter for database nova_cell0 Sep 05 12:28:30.105416 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_db.sqlalchemy.engines [None req-58c90312-0773-432f-9c97-62826a171175 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:28:30.112190 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writer thread running {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:28:30.149149 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writer thread running {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:28:30.160063 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO dbcounter [None req-6372a584-4292-4434-a2bd-6c1a17afad80 None None] Registered counter for database nova_cell0 Sep 05 12:28:30.172557 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_db.sqlalchemy.engines [None req-6372a584-4292-4434-a2bd-6c1a17afad80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121211) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:28:30.177713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writer thread running {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:28:30.491327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: WARNING keystonemiddleware.auth_token [None req-58c90312-0773-432f-9c97-62826a171175 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 12:28:30.499805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: WARNING keystonemiddleware.auth_token [None req-58c90312-0773-432f-9c97-62826a171175 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 12:28:30.519816 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: WARNING keystonemiddleware.auth_token [None req-6372a584-4292-4434-a2bd-6c1a17afad80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 12:28:30.527409 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: WARNING keystonemiddleware.auth_token [None req-6372a584-4292-4434-a2bd-6c1a17afad80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 12:28:30.875349 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: WARNING keystonemiddleware.auth_token [None req-6372a584-4292-4434-a2bd-6c1a17afad80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 12:28:30.877510 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: WARNING keystonemiddleware.auth_token [None req-58c90312-0773-432f-9c97-62826a171175 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 12:28:30.881777 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: WARNING keystonemiddleware.auth_token [None req-6372a584-4292-4434-a2bd-6c1a17afad80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 12:28:30.883853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: WARNING keystonemiddleware.auth_token [None req-58c90312-0773-432f-9c97-62826a171175 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 12:28:30.887384 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5623518f29c0 pid: 121211 (default app) Sep 05 12:28:30.889155 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5623518f29c0 pid: 121210 (default app) Sep 05 12:29:08.378961 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=3 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:08.380185 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=3 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:08.381055 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=3 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:08.382009 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=3 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:08.613382 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=3 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:08.614497 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=3 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:08.615240 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=3 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:08.615991 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=3 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:10.046536 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f9f080fe-f8cf-493f-9cc9-2e38ff2c8640 tempest-VolumesGetTestJSON-1029993944 tempest-VolumesGetTestJSON-1029993944-project] Action: 'create', calling method: .version_select at 0x7fe71389b280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1232624251", "metadata": {"Type": "work"}}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:10.237921 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-8247c5ee-205e-40f2-83c4-901127402214 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Action: 'create', calling method: .version_select at 0x7fe71389b280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1573546681"}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:12.035524 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-8247c5ee-205e-40f2-83c4-901127402214 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.431469 Sep 05 12:29:12.047309 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 1/1] 10.222.0.62 () {60 vars in 1155 bytes} [Mon Sep 5 12:29:08 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3435 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 05 12:29:12.054340 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-6a2c77c0-daf4-485a-9080-49f40a144eec tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Calling method '.version_select at 0x7fe71377b160>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:12.097887 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f9f080fe-f8cf-493f-9cc9-2e38ff2c8640 tempest-VolumesGetTestJSON-1029993944 tempest-VolumesGetTestJSON-1029993944-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.719213 Sep 05 12:29:12.097887 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 1/2] 10.222.0.62 () {60 vars in 1156 bytes} [Mon Sep 5 12:29:08 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3722 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 05 12:29:12.112712 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-87b1749d-aac3-44da-a637-6c87c14d3525 tempest-VolumesGetTestJSON-1029993944 tempest-VolumesGetTestJSON-1029993944-project] Calling method '.version_select at 0x7fe713779160>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:12.181604 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-6a2c77c0-daf4-485a-9080-49f40a144eec tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/96b8d7e8-a0af-4b29-a161-8f508f21f2b2" status: 200 len: 345 microversion: 2.1 time: 0.133085 Sep 05 12:29:12.182607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 2/3] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Sep 5 12:29:12 2022] GET /compute/v2.1/os-volumes/96b8d7e8-a0af-4b29-a161-8f508f21f2b2 => generated 345 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:12.263790 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-87b1749d-aac3-44da-a637-6c87c14d3525 tempest-VolumesGetTestJSON-1029993944 tempest-VolumesGetTestJSON-1029993944-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/073e9489-2587-478e-b9fb-8a64a86e03fa" status: 200 len: 353 microversion: 2.1 time: 0.159478 Sep 05 12:29:12.265342 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 2/4] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Sep 5 12:29:12 2022] GET /compute/v2.1/os-volumes/073e9489-2587-478e-b9fb-8a64a86e03fa => generated 353 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:13.197527 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-98364945-1a0f-48bf-bf14-1f5fae409496 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Calling method '.version_select at 0x7fe71377b8b0>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:13.285608 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-245c68c9-8aa5-4ede-86c7-0632bd7e58c7 tempest-VolumesGetTestJSON-1029993944 tempest-VolumesGetTestJSON-1029993944-project] Calling method '.version_select at 0x7fe713779820>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:13.294121 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-98364945-1a0f-48bf-bf14-1f5fae409496 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/96b8d7e8-a0af-4b29-a161-8f508f21f2b2" status: 200 len: 345 microversion: 2.1 time: 0.101095 Sep 05 12:29:13.302729 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 3/5] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Sep 5 12:29:13 2022] GET /compute/v2.1/os-volumes/96b8d7e8-a0af-4b29-a161-8f508f21f2b2 => generated 345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:13.372039 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-245c68c9-8aa5-4ede-86c7-0632bd7e58c7 tempest-VolumesGetTestJSON-1029993944 tempest-VolumesGetTestJSON-1029993944-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/073e9489-2587-478e-b9fb-8a64a86e03fa" status: 200 len: 354 microversion: 2.1 time: 0.090019 Sep 05 12:29:13.381428 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 3/6] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Sep 5 12:29:13 2022] GET /compute/v2.1/os-volumes/073e9489-2587-478e-b9fb-8a64a86e03fa => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:13.387831 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-df38a945-99bf-40c8-959e-45dd0caca1a1 tempest-VolumesGetTestJSON-1029993944 tempest-VolumesGetTestJSON-1029993944-project] Calling method '.version_select at 0x7fe71377bf70>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:13.470760 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-df38a945-99bf-40c8-959e-45dd0caca1a1 tempest-VolumesGetTestJSON-1029993944 tempest-VolumesGetTestJSON-1029993944-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/073e9489-2587-478e-b9fb-8a64a86e03fa" status: 200 len: 354 microversion: 2.1 time: 0.085905 Sep 05 12:29:13.471823 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 4/7] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Sep 5 12:29:13 2022] GET /compute/v2.1/os-volumes/073e9489-2587-478e-b9fb-8a64a86e03fa => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:13.493240 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-fc60046a-75f9-4dd8-bf60-3dad4a2a2e52 tempest-VolumesGetTestJSON-1029993944 tempest-VolumesGetTestJSON-1029993944-project] Calling method '.version_select at 0x7fe713779ee0>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:13.851037 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-fc60046a-75f9-4dd8-bf60-3dad4a2a2e52 tempest-VolumesGetTestJSON-1029993944 tempest-VolumesGetTestJSON-1029993944-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/073e9489-2587-478e-b9fb-8a64a86e03fa" status: 202 len: 0 microversion: 2.1 time: 0.362844 Sep 05 12:29:13.852026 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 4/8] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Sep 5 12:29:13 2022] DELETE /compute/v2.1/os-volumes/073e9489-2587-478e-b9fb-8a64a86e03fa => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:29:13.861937 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-caa8f20f-f28f-428c-8327-a94fc059999e tempest-VolumesGetTestJSON-1029993944 tempest-VolumesGetTestJSON-1029993944-project] Calling method '.version_select at 0x7fe71377b9d0>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:13.974981 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-caa8f20f-f28f-428c-8327-a94fc059999e tempest-VolumesGetTestJSON-1029993944 tempest-VolumesGetTestJSON-1029993944-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/073e9489-2587-478e-b9fb-8a64a86e03fa" status: 200 len: 353 microversion: 2.1 time: 0.117855 Sep 05 12:29:13.981776 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 5/9] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Sep 5 12:29:13 2022] GET /compute/v2.1/os-volumes/073e9489-2587-478e-b9fb-8a64a86e03fa => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:14.327786 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-88c4e277-07b1-4ed2-a223-29fdf1c96e9f tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Calling method '.version_select at 0x7fe713779b80>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:14.613150 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-88c4e277-07b1-4ed2-a223-29fdf1c96e9f tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/96b8d7e8-a0af-4b29-a161-8f508f21f2b2" status: 200 len: 346 microversion: 2.1 time: 0.307772 Sep 05 12:29:14.616759 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 5/10] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Sep 5 12:29:14 2022] GET /compute/v2.1/os-volumes/96b8d7e8-a0af-4b29-a161-8f508f21f2b2 => generated 346 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:14.636324 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-15bdbebf-467a-480b-9e52-e04136b05459 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Action: 'create', calling method: .version_select at 0x7fe71377b430>, body: {"snapshot": {"volume_id": "96b8d7e8-a0af-4b29-a161-8f508f21f2b2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1807392641"}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:14.990878 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e2a625a0-33e9-4612-8a1f-78b380b403eb tempest-VolumesGetTestJSON-1029993944 tempest-VolumesGetTestJSON-1029993944-project] Calling method '.version_select at 0x7fe713779430>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:15.082213 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-e2a625a0-33e9-4612-8a1f-78b380b403eb tempest-VolumesGetTestJSON-1029993944 tempest-VolumesGetTestJSON-1029993944-project] HTTP exception thrown: Volume 073e9489-2587-478e-b9fb-8a64a86e03fa could not be found. Sep 05 12:29:15.088684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e2a625a0-33e9-4612-8a1f-78b380b403eb tempest-VolumesGetTestJSON-1029993944 tempest-VolumesGetTestJSON-1029993944-project] Request method failure captured: Sep 05 12:29:15.088684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: GET /compute/v2.1/os-volumes/073e9489-2587-478e-b9fb-8a64a86e03fa HTTP/1.1 Sep 05 12:29:15.088684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:29:15.088684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:29:15.088684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:29:15.088684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:29:15.088684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:29:15.088684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:29:15.088684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:29:15.088684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:29:15.088684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFeuUnboWFG9kbPDXdn0ZIA9Kbx6wQOLP0ieTEEiDB5u40Q7CFt4Q95v0b9aJOPbIwbTP2ZEAZx0NlDWyzDH48D0kO4WuriYxZi4MtvgsuoY9xb-TREbzrGn2bLvVhj_i4sbY9kSp87EGXvjzvMVyv0YY13MwIy-2lK7G2yg4bkFaGIk Sep 05 12:29:15.088684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:29:15.088684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:29:15.088684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:29:15.088684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:29:15.088684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:29:15.088684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:29:15.088684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 2c59704f053a485ca0d4b0a16f675cc9 Sep 05 12:29:15.088684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-VolumesGetTestJSON-1029993944 Sep 05 12:29:15.088684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:29:15.088684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:29:15.089919 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2c59704f053a485ca0d4b0a16f675cc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2c59704f053a485ca0d4b0a16f675cc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2c59704f053a485ca0d4b0a16f675cc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2c59704f053a485ca0d4b0a16f675cc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:29:15.089919 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-VolumesGetTestJSON-1029993944 Sep 05 12:29:15.089919 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 2c59704f053a485ca0d4b0a16f675cc9 Sep 05 12:29:15.089919 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-VolumesGetTestJSON-1029993944 Sep 05 12:29:15.089919 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-VolumesGetTestJSON-1029993944-project Sep 05 12:29:15.089919 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:29:15.089919 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:29:15.089919 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: 70a571ba86fd47dbb6900b215b50f92f Sep 05 12:29:15.089919 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-VolumesGetTestJSON-1029993944-project Sep 05 12:29:15.089919 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: Sep 05 12:29:15.089919 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Volume 073e9489-2587-478e-b9fb-8a64a86e03fa could not be found. Sep 05 12:29:15.089919 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': '073e9489-2587-478e-b9fb-8a64a86e03fa'} Sep 05 12:29:15.089919 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:29:15.090534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:15.090534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:29:15.090534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:29:15.090534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 12:29:15.090534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 12:29:15.090534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 12:29:15.090534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 12:29:15.090534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 12:29:15.090534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 12:29:15.090534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 12:29:15.090534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 12:29:15.090534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:29:15.090534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:29:15.090534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:29:15.090534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:29:15.090534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 073e9489-2587-478e-b9fb-8a64a86e03fa could not be found. (HTTP 404) (Request-ID: req-b009cec1-e83d-41d6-afeb-39fd9e1e2085) Sep 05 12:29:15.090534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:29:15.090534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:29:15.090534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:29:15.091390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:15.091390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 05 12:29:15.091390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 05 12:29:15.091390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 12:29:15.091390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 12:29:15.091390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 12:29:15.091390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 12:29:15.091390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 12:29:15.091390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 12:29:15.091390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:29:15.091390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:29:15.091390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 12:29:15.091390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 12:29:15.091390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 12:29:15.091390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 12:29:15.091390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 12:29:15.091390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 12:29:15.091390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 12:29:15.091390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 12:29:15.092799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:29:15.092799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:29:15.092799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:29:15.092799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:29:15.092799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 073e9489-2587-478e-b9fb-8a64a86e03fa could not be found. Sep 05 12:29:15.092799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:29:15.092799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:29:15.092799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:29:15.092799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:15.092799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:29:15.092799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:29:15.092799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:29:15.092799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:29:15.092799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:29:15.092799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:29:15.092799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:29:15.092799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:29:15.092799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 05 12:29:15.092799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:29:15.093917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 073e9489-2587-478e-b9fb-8a64a86e03fa could not be found. Sep 05 12:29:15.093917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:29:15.093917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:29:15.093917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:29:15.093917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:15.093917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:29:15.093917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:29:15.093917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:29:15.093917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:29:15.093917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 073e9489-2587-478e-b9fb-8a64a86e03fa could not be found. Sep 05 12:29:15.093917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:29:15.093917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e2a625a0-33e9-4612-8a1f-78b380b403eb tempest-VolumesGetTestJSON-1029993944 tempest-VolumesGetTestJSON-1029993944-project] Returning 404 to user: Volume 073e9489-2587-478e-b9fb-8a64a86e03fa could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:29:15.093917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e2a625a0-33e9-4612-8a1f-78b380b403eb tempest-VolumesGetTestJSON-1029993944 tempest-VolumesGetTestJSON-1029993944-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/073e9489-2587-478e-b9fb-8a64a86e03fa" status: 404 len: 109 microversion: 2.1 time: 0.104958 Sep 05 12:29:15.099137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 6/11] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Sep 5 12:29:14 2022] GET /compute/v2.1/os-volumes/073e9489-2587-478e-b9fb-8a64a86e03fa => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:29:15.439446 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-15bdbebf-467a-480b-9e52-e04136b05459 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] 10.222.0.62 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.807213 Sep 05 12:29:15.452209 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 6/12] 10.222.0.62 () {60 vars in 1162 bytes} [Mon Sep 5 12:29:14 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:15.453138 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-fd69f05e-ade8-4ae4-a2ee-8e1e24c5a6f1 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Calling method '.version_select at 0x7fe7136d48b0>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:15.632869 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-fd69f05e-ade8-4ae4-a2ee-8e1e24c5a6f1 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/5383b26d-f187-4701-bc22-0580407f9055" status: 200 len: 287 microversion: 2.1 time: 0.183472 Sep 05 12:29:15.633995 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 7/13] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Sep 5 12:29:15 2022] GET /compute/v2.1/os-snapshots/5383b26d-f187-4701-bc22-0580407f9055 => generated 287 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:29:15.663781 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e42b9f2b-67cd-4d69-abe6-74900e402ea6 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Calling method '.version_select at 0x7fe713706af0>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:15.802147 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-e42b9f2b-67cd-4d69-abe6-74900e402ea6 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.157713 Sep 05 12:29:15.803425 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 7/14] 10.222.0.62 () {58 vars in 1140 bytes} [Mon Sep 5 12:29:15 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:15.815952 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e4be794b-ecf2-484e-81e6-2845e984679b tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Calling method '.version_select at 0x7fe7136eb040>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:15.897352 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e4be794b-ecf2-484e-81e6-2845e984679b tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/5383b26d-f187-4701-bc22-0580407f9055" status: 200 len: 287 microversion: 2.1 time: 0.086365 Sep 05 12:29:15.898850 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 8/15] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Sep 5 12:29:15 2022] GET /compute/v2.1/os-snapshots/5383b26d-f187-4701-bc22-0580407f9055 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:16.913227 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4c2e2eae-1908-4b49-81df-892948217a05 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Calling method '.version_select at 0x7fe7137069d0>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:17.003960 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-4c2e2eae-1908-4b49-81df-892948217a05 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/5383b26d-f187-4701-bc22-0580407f9055" status: 200 len: 287 microversion: 2.1 time: 0.096783 Sep 05 12:29:17.010077 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 8/16] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Sep 5 12:29:16 2022] GET /compute/v2.1/os-snapshots/5383b26d-f187-4701-bc22-0580407f9055 => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:18.019213 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3020d389-de65-4ea9-88a1-20efdfca7574 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Calling method '.version_select at 0x7fe7136eb700>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:18.114615 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3020d389-de65-4ea9-88a1-20efdfca7574 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/5383b26d-f187-4701-bc22-0580407f9055" status: 200 len: 287 microversion: 2.1 time: 0.100534 Sep 05 12:29:18.115185 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 9/17] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Sep 5 12:29:18 2022] GET /compute/v2.1/os-snapshots/5383b26d-f187-4701-bc22-0580407f9055 => generated 287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:19.130717 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-43c817ee-e316-4717-aaa3-628b5665508f tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Calling method '.version_select at 0x7fe7137063a0>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:19.201178 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-43c817ee-e316-4717-aaa3-628b5665508f tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/5383b26d-f187-4701-bc22-0580407f9055" status: 200 len: 287 microversion: 2.1 time: 0.077674 Sep 05 12:29:19.202558 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 9/18] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Sep 5 12:29:19 2022] GET /compute/v2.1/os-snapshots/5383b26d-f187-4701-bc22-0580407f9055 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:19.932245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e7412cbd-9ce6-4fc5-bb1f-4f9115d9a9cf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Action: 'create', calling method: .version_select at 0x7fe7136d4e50>, body: {"keypair": {"name": "tempest-keypair-1075329398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAD62COMqDPTqKu/9PlS0M2+b4zudv0AtHmnzgEyq9rNZSMWDVDgMVuXe06NJx2gttZrPDKDtzeFTSR6Kbqu20gvHYrk3k7JfKTn1cxgNDWAeNN3Q45+He1QRyuY0OER4Q=="}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:19.998789 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-e7412cbd-9ce6-4fc5-bb1f-4f9115d9a9cf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Getting quotas for project 4f6830d2e75a47c8a757d4a66c6695ca. Resources: {'key_pairs'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:29:20.011330 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-e7412cbd-9ce6-4fc5-bb1f-4f9115d9a9cf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Getting quotas for user de2273220e824339bd13d968c75df26b and project 4f6830d2e75a47c8a757d4a66c6695ca. Resources: {'key_pairs'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:29:20.191833 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e7412cbd-9ce6-4fc5-bb1f-4f9115d9a9cf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.575612 Sep 05 12:29:20.193613 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 10/19] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Sep 5 12:29:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:20.225177 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7ed1b51d-353b-40ba-adb6-15304a9b673d tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Calling method '.version_select at 0x7fe713704430>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:20.286858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-7ed1b51d-353b-40ba-adb6-15304a9b673d tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/5383b26d-f187-4701-bc22-0580407f9055" status: 200 len: 288 microversion: 2.1 time: 0.074875 Sep 05 12:29:20.288068 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 10/20] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Sep 5 12:29:20 2022] GET /compute/v2.1/os-snapshots/5383b26d-f187-4701-bc22-0580407f9055 => generated 288 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:20.300894 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-cef9dabc-15b8-4528-815e-0df0878e2720 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Calling method '.version_select at 0x7fe713640f70>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:20.513077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-cef9dabc-15b8-4528-815e-0df0878e2720 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] 10.222.0.62 "DELETE /compute/v2.1/os-snapshots/5383b26d-f187-4701-bc22-0580407f9055" status: 202 len: 0 microversion: 2.1 time: 0.217095 Sep 05 12:29:20.513996 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 11/21] 10.222.0.62 () {58 vars in 1254 bytes} [Mon Sep 5 12:29:20 2022] DELETE /compute/v2.1/os-snapshots/5383b26d-f187-4701-bc22-0580407f9055 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:29:20.523567 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-9407f0a4-6d02-401f-a879-3fe9dc68858e tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Calling method '.version_select at 0x7fe713706e50>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:20.587987 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-9407f0a4-6d02-401f-a879-3fe9dc68858e tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/5383b26d-f187-4701-bc22-0580407f9055" status: 200 len: 287 microversion: 2.1 time: 0.067666 Sep 05 12:29:20.588748 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 11/22] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Sep 5 12:29:20 2022] GET /compute/v2.1/os-snapshots/5383b26d-f187-4701-bc22-0580407f9055 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:21.602936 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7f9e3ebe-ba62-49f7-b7b6-cddee3fb3a48 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Calling method '.version_select at 0x7fe713640af0>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:21.658380 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-7f9e3ebe-ba62-49f7-b7b6-cddee3fb3a48 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] HTTP exception thrown: Snapshot 5383b26d-f187-4701-bc22-0580407f9055 could not be found. Sep 05 12:29:21.661195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7f9e3ebe-ba62-49f7-b7b6-cddee3fb3a48 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Request method failure captured: Sep 05 12:29:21.661195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: GET /compute/v2.1/os-snapshots/5383b26d-f187-4701-bc22-0580407f9055 HTTP/1.1 Sep 05 12:29:21.661195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:29:21.661195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:29:21.661195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:29:21.661195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:29:21.661195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:29:21.661195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:29:21.661195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:29:21.661195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:29:21.661195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFeuUjlnjY91aE2OMXe2j31WYeYthBaclgBKZFU4dNVlr-48UvgXHGlaRDbWGTe8f3KA0GUzHZF-PJ0cHPQV5De8Ond5qOnz-fQjaK4nE-NE2XSwAD9fb8fCGCLCMkIn7RCHoecFGhqdVnD8v9y6ItVb5wXiXQY9gBWVUquJ7LWlsrVs Sep 05 12:29:21.661195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:29:21.661195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:29:21.661195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:29:21.661195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:29:21.661195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:29:21.661195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:29:21.661195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: bc9d09b0d78847e5af5665e83dc34be9 Sep 05 12:29:21.661195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1509385348 Sep 05 12:29:21.661195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:29:21.661195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:29:21.662586 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc9d09b0d78847e5af5665e83dc34be9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bc9d09b0d78847e5af5665e83dc34be9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc9d09b0d78847e5af5665e83dc34be9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bc9d09b0d78847e5af5665e83dc34be9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:29:21.662586 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1509385348 Sep 05 12:29:21.662586 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: bc9d09b0d78847e5af5665e83dc34be9 Sep 05 12:29:21.662586 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1509385348 Sep 05 12:29:21.662586 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-VolumesSnapshotsTestJSON-1509385348-project Sep 05 12:29:21.662586 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:29:21.662586 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:29:21.662586 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: 0c22e8434a5248338778ab9a6da59434 Sep 05 12:29:21.662586 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1509385348-project Sep 05 12:29:21.662586 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: Sep 05 12:29:21.662586 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Snapshot 5383b26d-f187-4701-bc22-0580407f9055 could not be found. Sep 05 12:29:21.662586 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': '5383b26d-f187-4701-bc22-0580407f9055'} Sep 05 12:29:21.662586 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:29:21.663377 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:21.663377 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 05 12:29:21.663377 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 05 12:29:21.663377 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 05 12:29:21.663377 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 05 12:29:21.663377 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 05 12:29:21.663377 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 05 12:29:21.663377 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 12:29:21.663377 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 12:29:21.663377 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 12:29:21.663377 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 12:29:21.663377 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:29:21.663377 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:29:21.663377 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:29:21.663377 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:29:21.663377 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5383b26d-f187-4701-bc22-0580407f9055 could not be found. (HTTP 404) (Request-ID: req-e440bd6e-fb03-41a3-9efa-966903819d02) Sep 05 12:29:21.663377 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:29:21.663377 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:29:21.664461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:29:21.664461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:21.664461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 05 12:29:21.664461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 05 12:29:21.664461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 12:29:21.664461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 12:29:21.664461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 05 12:29:21.664461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 05 12:29:21.664461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 12:29:21.664461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 12:29:21.664461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 05 12:29:21.664461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 05 12:29:21.664461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 05 12:29:21.664461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 05 12:29:21.664461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 05 12:29:21.664461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 05 12:29:21.664461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 12:29:21.664461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 12:29:21.664461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 12:29:21.665713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 12:29:21.665713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:29:21.665713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:29:21.665713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:29:21.665713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:29:21.665713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5383b26d-f187-4701-bc22-0580407f9055 could not be found. Sep 05 12:29:21.665713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:29:21.665713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:29:21.665713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:29:21.665713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:21.665713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:29:21.665713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:29:21.665713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:29:21.665713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:29:21.665713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:29:21.665713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:29:21.665713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:29:21.665713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:29:21.665713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 05 12:29:21.665713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:29:21.666965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5383b26d-f187-4701-bc22-0580407f9055 could not be found. Sep 05 12:29:21.666965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:29:21.666965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:29:21.666965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:29:21.666965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:21.666965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:29:21.666965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:29:21.666965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:29:21.666965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:29:21.666965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5383b26d-f187-4701-bc22-0580407f9055 could not be found. Sep 05 12:29:21.666965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:29:21.668540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7f9e3ebe-ba62-49f7-b7b6-cddee3fb3a48 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Returning 404 to user: Snapshot 5383b26d-f187-4701-bc22-0580407f9055 could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:29:21.669538 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-7f9e3ebe-ba62-49f7-b7b6-cddee3fb3a48 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/5383b26d-f187-4701-bc22-0580407f9055" status: 404 len: 111 microversion: 2.1 time: 0.070998 Sep 05 12:29:21.670245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 12/23] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Sep 5 12:29:21 2022] GET /compute/v2.1/os-snapshots/5383b26d-f187-4701-bc22-0580407f9055 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:29:21.678626 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-6680ea33-87aa-43e4-a6f5-b90f23507cf6 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Calling method '.version_select at 0x7fe7137068b0>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:21.974459 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-6680ea33-87aa-43e4-a6f5-b90f23507cf6 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/96b8d7e8-a0af-4b29-a161-8f508f21f2b2" status: 202 len: 0 microversion: 2.1 time: 0.299499 Sep 05 12:29:21.975606 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 12/24] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Sep 5 12:29:21 2022] DELETE /compute/v2.1/os-volumes/96b8d7e8-a0af-4b29-a161-8f508f21f2b2 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:29:21.993297 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a323e1a1-bf10-499f-85d7-f25a8c8b0195 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Calling method '.version_select at 0x7fe713674c10>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:22.182388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a323e1a1-bf10-499f-85d7-f25a8c8b0195 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/96b8d7e8-a0af-4b29-a161-8f508f21f2b2" status: 200 len: 345 microversion: 2.1 time: 0.202509 Sep 05 12:29:22.189892 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 13/25] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Sep 5 12:29:21 2022] GET /compute/v2.1/os-volumes/96b8d7e8-a0af-4b29-a161-8f508f21f2b2 => generated 345 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:23.198589 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-3ae7bb6e-d89c-44ad-a277-19556311bce8 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Calling method '.version_select at 0x7fe713704310>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:23.300021 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-3ae7bb6e-d89c-44ad-a277-19556311bce8 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] HTTP exception thrown: Volume 96b8d7e8-a0af-4b29-a161-8f508f21f2b2 could not be found. Sep 05 12:29:23.306852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-3ae7bb6e-d89c-44ad-a277-19556311bce8 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Request method failure captured: Sep 05 12:29:23.306852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/os-volumes/96b8d7e8-a0af-4b29-a161-8f508f21f2b2 HTTP/1.1 Sep 05 12:29:23.306852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:29:23.306852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:29:23.306852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:29:23.306852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:29:23.306852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:29:23.306852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:29:23.306852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:29:23.306852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:29:23.306852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFeuUjlnjY91aE2OMXe2j31WYeYthBaclgBKZFU4dNVlr-48UvgXHGlaRDbWGTe8f3KA0GUzHZF-PJ0cHPQV5De8Ond5qOnz-fQjaK4nE-NE2XSwAD9fb8fCGCLCMkIn7RCHoecFGhqdVnD8v9y6ItVb5wXiXQY9gBWVUquJ7LWlsrVs Sep 05 12:29:23.306852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:29:23.306852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:29:23.306852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:29:23.306852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:29:23.306852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:29:23.306852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:29:23.306852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: bc9d09b0d78847e5af5665e83dc34be9 Sep 05 12:29:23.306852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1509385348 Sep 05 12:29:23.306852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:29:23.306852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:29:23.308232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc9d09b0d78847e5af5665e83dc34be9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bc9d09b0d78847e5af5665e83dc34be9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc9d09b0d78847e5af5665e83dc34be9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bc9d09b0d78847e5af5665e83dc34be9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:29:23.308232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1509385348 Sep 05 12:29:23.308232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: bc9d09b0d78847e5af5665e83dc34be9 Sep 05 12:29:23.308232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1509385348 Sep 05 12:29:23.308232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-VolumesSnapshotsTestJSON-1509385348-project Sep 05 12:29:23.308232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:29:23.308232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:29:23.308232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: 0c22e8434a5248338778ab9a6da59434 Sep 05 12:29:23.308232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1509385348-project Sep 05 12:29:23.308232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: Sep 05 12:29:23.308232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Volume 96b8d7e8-a0af-4b29-a161-8f508f21f2b2 could not be found. Sep 05 12:29:23.308232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': '96b8d7e8-a0af-4b29-a161-8f508f21f2b2'} Sep 05 12:29:23.308232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:29:23.308948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:23.308948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:29:23.308948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:29:23.308948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 12:29:23.308948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 12:29:23.308948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 12:29:23.308948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 12:29:23.308948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 12:29:23.308948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 12:29:23.308948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 12:29:23.308948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 12:29:23.308948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:29:23.308948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:29:23.308948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:29:23.308948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:29:23.308948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 96b8d7e8-a0af-4b29-a161-8f508f21f2b2 could not be found. (HTTP 404) (Request-ID: req-425333d4-a73b-4494-9e39-c87044952ada) Sep 05 12:29:23.308948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:29:23.308948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:29:23.308948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:29:23.310354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:23.310354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 05 12:29:23.310354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 05 12:29:23.310354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 12:29:23.310354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 12:29:23.310354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 12:29:23.310354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 12:29:23.310354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 12:29:23.310354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 12:29:23.310354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:29:23.310354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:29:23.310354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 12:29:23.310354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 12:29:23.310354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 12:29:23.310354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 12:29:23.310354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 12:29:23.310354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 12:29:23.310354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 12:29:23.310354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 12:29:23.312054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:29:23.312054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:29:23.312054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:29:23.312054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:29:23.312054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 96b8d7e8-a0af-4b29-a161-8f508f21f2b2 could not be found. Sep 05 12:29:23.312054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:29:23.312054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:29:23.312054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:29:23.312054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:23.312054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:29:23.312054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:29:23.312054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:29:23.312054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:29:23.312054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:29:23.312054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:29:23.312054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:29:23.312054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:29:23.312054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 05 12:29:23.312054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:29:23.315029 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 96b8d7e8-a0af-4b29-a161-8f508f21f2b2 could not be found. Sep 05 12:29:23.315029 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:29:23.315029 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:29:23.315029 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:29:23.315029 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:23.315029 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:29:23.315029 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:29:23.315029 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:29:23.315029 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:29:23.315029 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 96b8d7e8-a0af-4b29-a161-8f508f21f2b2 could not be found. Sep 05 12:29:23.315029 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:29:23.315029 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-3ae7bb6e-d89c-44ad-a277-19556311bce8 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Returning 404 to user: Volume 96b8d7e8-a0af-4b29-a161-8f508f21f2b2 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:29:23.315029 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-3ae7bb6e-d89c-44ad-a277-19556311bce8 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/96b8d7e8-a0af-4b29-a161-8f508f21f2b2" status: 404 len: 109 microversion: 2.1 time: 0.112257 Sep 05 12:29:23.315029 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 13/26] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Sep 5 12:29:23 2022] GET /compute/v2.1/os-volumes/96b8d7e8-a0af-4b29-a161-8f508f21f2b2 => generated 109 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 05 12:29:23.328896 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-04d64c92-e4dc-479c-9a1b-1d041bc18687 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Calling method '.version_select at 0x7fe7136748b0>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:23.404002 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-04d64c92-e4dc-479c-9a1b-1d041bc18687 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] HTTP exception thrown: Volume 96b8d7e8-a0af-4b29-a161-8f508f21f2b2 could not be found. Sep 05 12:29:23.413360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-04d64c92-e4dc-479c-9a1b-1d041bc18687 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Request method failure captured: Sep 05 12:29:23.413360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: DELETE /compute/v2.1/os-volumes/96b8d7e8-a0af-4b29-a161-8f508f21f2b2 HTTP/1.1 Sep 05 12:29:23.413360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:29:23.413360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:29:23.413360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:29:23.413360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:29:23.413360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:29:23.413360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:29:23.413360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:29:23.413360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:29:23.413360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFeuUjlnjY91aE2OMXe2j31WYeYthBaclgBKZFU4dNVlr-48UvgXHGlaRDbWGTe8f3KA0GUzHZF-PJ0cHPQV5De8Ond5qOnz-fQjaK4nE-NE2XSwAD9fb8fCGCLCMkIn7RCHoecFGhqdVnD8v9y6ItVb5wXiXQY9gBWVUquJ7LWlsrVs Sep 05 12:29:23.413360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:29:23.413360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:29:23.413360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:29:23.413360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:29:23.413360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:29:23.413360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:29:23.413360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: bc9d09b0d78847e5af5665e83dc34be9 Sep 05 12:29:23.413360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1509385348 Sep 05 12:29:23.413360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:29:23.413360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:29:23.414773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc9d09b0d78847e5af5665e83dc34be9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bc9d09b0d78847e5af5665e83dc34be9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc9d09b0d78847e5af5665e83dc34be9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bc9d09b0d78847e5af5665e83dc34be9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:29:23.414773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1509385348 Sep 05 12:29:23.414773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: bc9d09b0d78847e5af5665e83dc34be9 Sep 05 12:29:23.414773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1509385348 Sep 05 12:29:23.414773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-VolumesSnapshotsTestJSON-1509385348-project Sep 05 12:29:23.414773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:29:23.414773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:29:23.414773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: 0c22e8434a5248338778ab9a6da59434 Sep 05 12:29:23.414773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1509385348-project Sep 05 12:29:23.414773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: Sep 05 12:29:23.414773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Volume 96b8d7e8-a0af-4b29-a161-8f508f21f2b2 could not be found. Sep 05 12:29:23.414773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': '96b8d7e8-a0af-4b29-a161-8f508f21f2b2'} Sep 05 12:29:23.414773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:29:23.415584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:23.415584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:29:23.415584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:29:23.415584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 12:29:23.415584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 12:29:23.415584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 12:29:23.415584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 12:29:23.415584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 12:29:23.415584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 12:29:23.415584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 12:29:23.415584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 12:29:23.415584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:29:23.415584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:29:23.415584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:29:23.415584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:29:23.415584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 96b8d7e8-a0af-4b29-a161-8f508f21f2b2 could not be found. (HTTP 404) (Request-ID: req-056bb3e4-26fd-46f1-a4a3-69f39c8acd19) Sep 05 12:29:23.415584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:29:23.415584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:29:23.415584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:29:23.417879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:23.417879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 05 12:29:23.417879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 05 12:29:23.417879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 12:29:23.417879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 12:29:23.417879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 12:29:23.417879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 12:29:23.417879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 12:29:23.417879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 12:29:23.417879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:29:23.417879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:29:23.417879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 12:29:23.417879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 12:29:23.417879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 12:29:23.417879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 12:29:23.417879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 12:29:23.417879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 12:29:23.417879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 12:29:23.417879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 12:29:23.423834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:29:23.423834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:29:23.423834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:29:23.423834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:29:23.423834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 96b8d7e8-a0af-4b29-a161-8f508f21f2b2 could not be found. Sep 05 12:29:23.423834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:29:23.423834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:29:23.423834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:29:23.423834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:23.423834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:29:23.423834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:29:23.423834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:29:23.423834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:29:23.423834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:29:23.423834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:29:23.423834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:29:23.423834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:29:23.423834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 05 12:29:23.423834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:29:23.425152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 96b8d7e8-a0af-4b29-a161-8f508f21f2b2 could not be found. Sep 05 12:29:23.425152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:29:23.425152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:29:23.425152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:29:23.425152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:23.425152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:29:23.425152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:29:23.425152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:29:23.425152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:29:23.425152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 96b8d7e8-a0af-4b29-a161-8f508f21f2b2 could not be found. Sep 05 12:29:23.425152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:29:23.425152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-04d64c92-e4dc-479c-9a1b-1d041bc18687 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Returning 404 to user: Volume 96b8d7e8-a0af-4b29-a161-8f508f21f2b2 could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:29:23.425152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-04d64c92-e4dc-479c-9a1b-1d041bc18687 tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/96b8d7e8-a0af-4b29-a161-8f508f21f2b2" status: 404 len: 109 microversion: 2.1 time: 0.104174 Sep 05 12:29:23.427383 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 14/27] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Sep 5 12:29:23 2022] DELETE /compute/v2.1/os-volumes/96b8d7e8-a0af-4b29-a161-8f508f21f2b2 => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:29:23.439804 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ec724cff-3626-47f4-ad7a-1c08a0939b8b tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Calling method '.version_select at 0x7fe713704d30>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:23.574547 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-ec724cff-3626-47f4-ad7a-1c08a0939b8b tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] HTTP exception thrown: Volume 96b8d7e8-a0af-4b29-a161-8f508f21f2b2 could not be found. Sep 05 12:29:23.576734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ec724cff-3626-47f4-ad7a-1c08a0939b8b tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Request method failure captured: Sep 05 12:29:23.576734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/os-volumes/96b8d7e8-a0af-4b29-a161-8f508f21f2b2 HTTP/1.1 Sep 05 12:29:23.576734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:29:23.576734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:29:23.576734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:29:23.576734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:29:23.576734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:29:23.576734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:29:23.576734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:29:23.576734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:29:23.576734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFeuUjlnjY91aE2OMXe2j31WYeYthBaclgBKZFU4dNVlr-48UvgXHGlaRDbWGTe8f3KA0GUzHZF-PJ0cHPQV5De8Ond5qOnz-fQjaK4nE-NE2XSwAD9fb8fCGCLCMkIn7RCHoecFGhqdVnD8v9y6ItVb5wXiXQY9gBWVUquJ7LWlsrVs Sep 05 12:29:23.576734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:29:23.576734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:29:23.576734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:29:23.576734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:29:23.576734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:29:23.576734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:29:23.576734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: bc9d09b0d78847e5af5665e83dc34be9 Sep 05 12:29:23.576734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1509385348 Sep 05 12:29:23.576734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:29:23.576734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:29:23.578043 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc9d09b0d78847e5af5665e83dc34be9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bc9d09b0d78847e5af5665e83dc34be9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc9d09b0d78847e5af5665e83dc34be9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bc9d09b0d78847e5af5665e83dc34be9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:29:23.578043 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1509385348 Sep 05 12:29:23.578043 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: bc9d09b0d78847e5af5665e83dc34be9 Sep 05 12:29:23.578043 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1509385348 Sep 05 12:29:23.578043 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-VolumesSnapshotsTestJSON-1509385348-project Sep 05 12:29:23.578043 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:29:23.578043 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:29:23.578043 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: 0c22e8434a5248338778ab9a6da59434 Sep 05 12:29:23.578043 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1509385348-project Sep 05 12:29:23.578043 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: Sep 05 12:29:23.578043 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Volume 96b8d7e8-a0af-4b29-a161-8f508f21f2b2 could not be found. Sep 05 12:29:23.578043 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': '96b8d7e8-a0af-4b29-a161-8f508f21f2b2'} Sep 05 12:29:23.578043 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:29:23.578807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:23.578807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:29:23.578807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:29:23.578807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 12:29:23.578807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 12:29:23.578807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 12:29:23.578807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 12:29:23.578807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 12:29:23.578807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 12:29:23.578807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 12:29:23.578807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 12:29:23.578807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:29:23.578807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:29:23.578807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:29:23.578807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:29:23.578807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 96b8d7e8-a0af-4b29-a161-8f508f21f2b2 could not be found. (HTTP 404) (Request-ID: req-6deba088-89fc-4438-9148-63b29513daba) Sep 05 12:29:23.578807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:29:23.578807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:29:23.578807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:29:23.579829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:23.579829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 05 12:29:23.579829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 05 12:29:23.579829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 12:29:23.579829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 12:29:23.579829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 12:29:23.579829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 12:29:23.579829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 12:29:23.579829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 12:29:23.579829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:29:23.579829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:29:23.579829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 12:29:23.579829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 12:29:23.579829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 12:29:23.579829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 12:29:23.579829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 12:29:23.579829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 12:29:23.579829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 12:29:23.579829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 12:29:23.580851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:29:23.580851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:29:23.580851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:29:23.580851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:29:23.580851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 96b8d7e8-a0af-4b29-a161-8f508f21f2b2 could not be found. Sep 05 12:29:23.580851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:29:23.580851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:29:23.580851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:29:23.580851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:23.580851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:29:23.580851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:29:23.580851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:29:23.580851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:29:23.580851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:29:23.580851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:29:23.580851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:29:23.580851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:29:23.580851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 05 12:29:23.580851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:29:23.581755 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 96b8d7e8-a0af-4b29-a161-8f508f21f2b2 could not be found. Sep 05 12:29:23.581755 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:29:23.581755 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:29:23.581755 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:29:23.581755 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:29:23.581755 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:29:23.581755 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:29:23.581755 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:29:23.581755 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:29:23.581755 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 96b8d7e8-a0af-4b29-a161-8f508f21f2b2 could not be found. Sep 05 12:29:23.581755 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:29:23.583969 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ec724cff-3626-47f4-ad7a-1c08a0939b8b tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] Returning 404 to user: Volume 96b8d7e8-a0af-4b29-a161-8f508f21f2b2 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:29:23.584965 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-ec724cff-3626-47f4-ad7a-1c08a0939b8b tempest-VolumesSnapshotsTestJSON-1509385348 tempest-VolumesSnapshotsTestJSON-1509385348-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/96b8d7e8-a0af-4b29-a161-8f508f21f2b2" status: 404 len: 109 microversion: 2.1 time: 0.153315 Sep 05 12:29:23.585680 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 14/28] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Sep 5 12:29:23 2022] GET /compute/v2.1/os-volumes/96b8d7e8-a0af-4b29-a161-8f508f21f2b2 => generated 109 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:29:27.156291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e0b28018-4c8b-427d-b852-fcf970594761 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Action: 'create', calling method: .version_select at 0x7fe713640670>, body: {"keypair": {"name": "tempest-keypair-1164867895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzR7E6hQTs90tkzbVQrY5b4xQaG9xylbWoVhnNM7dySrkz4+PE8O917C4Mc6Xhg9o6t+dCpefmvw63LLF3vGiyjAtZy7fOC96DRlTZperp0+OHmuLLQ4tZt0nM7hQ6zgA=="}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:27.204897 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-e0b28018-4c8b-427d-b852-fcf970594761 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Getting quotas for project 094bae935a1e4738b0c51d33c6d89e3a. Resources: {'key_pairs'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:29:27.223798 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-e0b28018-4c8b-427d-b852-fcf970594761 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Getting quotas for user 9a61a18900c44bea89647fc9ccdaf110 and project 094bae935a1e4738b0c51d33c6d89e3a. Resources: {'key_pairs'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:29:27.304909 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a42a544b-67d0-444c-b715-114558e5301a tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1023152062", "imageRef": "7844cf5b-4975-4cb9-a7f8-31cc5e52098a", "flavorRef": "452", "networks": [{"uuid": "348d5686-a592-4367-8b5a-edfed120b8fb"}]}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:27.363425 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e0b28018-4c8b-427d-b852-fcf970594761 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.724027 Sep 05 12:29:27.365316 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 15/29] 10.222.0.62 () {62 vars in 1200 bytes} [Mon Sep 5 12:29:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 726 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 05 12:29:27.604365 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.network.neutron [None req-a42a544b-67d0-444c-b715-114558e5301a tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] validate_networks() for [('348d5686-a592-4367-8b5a-edfed120b8fb', None, None, None, None, None)] {{(pid=121210) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:29:28.228501 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ca7d0e69-80dc-451d-b9bd-0a022a95e636 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1552995690", "imageRef": "7844cf5b-4975-4cb9-a7f8-31cc5e52098a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:28.388747 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.network.neutron [None req-ca7d0e69-80dc-451d-b9bd-0a022a95e636 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] validate_networks() for [('adc4bf76-da99-44ec-b79e-0ddca4fe97de', None, None, None, None, None)] {{(pid=121211) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:29:29.241892 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-a42a544b-67d0-444c-b715-114558e5301a tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Flavor limits 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:29:29.242980 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-a42a544b-67d0-444c-b715-114558e5301a tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Image limits 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:29:29.244040 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-a42a544b-67d0-444c-b715-114558e5301a tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Flavor pref 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:29:29.244655 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-a42a544b-67d0-444c-b715-114558e5301a tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Image pref 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:29:29.245251 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-a42a544b-67d0-444c-b715-114558e5301a tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:29:29.273005 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a42a544b-67d0-444c-b715-114558e5301a tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:29.275357 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a42a544b-67d0-444c-b715-114558e5301a tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:29.281019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a42a544b-67d0-444c-b715-114558e5301a tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:29.282179 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a42a544b-67d0-444c-b715-114558e5301a tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:29.284939 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a42a544b-67d0-444c-b715-114558e5301a tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:29.285635 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a42a544b-67d0-444c-b715-114558e5301a tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:29.395995 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-a42a544b-67d0-444c-b715-114558e5301a tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Getting quotas for project 19911e0c0b444897b621ce06dbd8296a. Resources: {'ram', 'instances', 'cores'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:29:29.410427 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-a42a544b-67d0-444c-b715-114558e5301a tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Getting quotas for user 69f976789f894296a86b4cf651fdc3ae and project 19911e0c0b444897b621ce06dbd8296a. Resources: {'ram', 'instances', 'cores'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:29:29.429620 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a42a544b-67d0-444c-b715-114558e5301a tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Going to run 1 instances... {{(pid=121210) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:29:29.434715 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a42a544b-67d0-444c-b715-114558e5301a tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7844cf5b-4975-4cb9-a7f8-31cc5e52098a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:29:29.710754 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a42a544b-67d0-444c-b715-114558e5301a tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.025530 Sep 05 12:29:29.714240 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 15/30] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Sep 5 12:29:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 05 12:29:29.730076 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-68488441-ff0d-44aa-892b-e3404b693ab1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-494849644", "imageRef": "7844cf5b-4975-4cb9-a7f8-31cc5e52098a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7678039b-6ecf-4526-a1ee-cbdc20c4b02b"}], "security_groups": [{"name": "tempest-securitygroup--2095863892"}], "key_name": "tempest-keypair-1075329398", "user_data": "}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:29.891763 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-ca7d0e69-80dc-451d-b9bd-0a022a95e636 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Flavor limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:29:29.892864 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-ca7d0e69-80dc-451d-b9bd-0a022a95e636 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Image limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:29:29.898673 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-ca7d0e69-80dc-451d-b9bd-0a022a95e636 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Flavor pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:29:29.899968 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-ca7d0e69-80dc-451d-b9bd-0a022a95e636 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Image pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:29:29.900536 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-ca7d0e69-80dc-451d-b9bd-0a022a95e636 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:29:29.943387 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ca7d0e69-80dc-451d-b9bd-0a022a95e636 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:29.947689 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ca7d0e69-80dc-451d-b9bd-0a022a95e636 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:29.948405 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ca7d0e69-80dc-451d-b9bd-0a022a95e636 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:29.951214 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ca7d0e69-80dc-451d-b9bd-0a022a95e636 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:29.952746 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ca7d0e69-80dc-451d-b9bd-0a022a95e636 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:29.953567 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ca7d0e69-80dc-451d-b9bd-0a022a95e636 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:30.072503 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-ca7d0e69-80dc-451d-b9bd-0a022a95e636 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Getting quotas for project 442bf64c97d945feb79f64cdd66baa28. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:29:30.081272 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-ca7d0e69-80dc-451d-b9bd-0a022a95e636 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Getting quotas for user f5543fbd902d441cb6f03d3155f1af8d and project 442bf64c97d945feb79f64cdd66baa28. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:29:30.141181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ca7d0e69-80dc-451d-b9bd-0a022a95e636 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Going to run 1 instances... {{(pid=121211) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:29:30.170069 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ca7d0e69-80dc-451d-b9bd-0a022a95e636 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7844cf5b-4975-4cb9-a7f8-31cc5e52098a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121211) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:29:30.249752 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.network.neutron [None req-68488441-ff0d-44aa-892b-e3404b693ab1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] validate_networks() for [('7678039b-6ecf-4526-a1ee-cbdc20c4b02b', None, None, None, None, None)] {{(pid=121210) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:29:30.472811 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ca7d0e69-80dc-451d-b9bd-0a022a95e636 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.106064 Sep 05 12:29:30.478019 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 16/31] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Sep 5 12:29:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 3112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:29:30.500539 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-dde3affe-4c43-4de9-b05c-b0c4791c4eb3 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:30.510876 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-dde3affe-4c43-4de9-b05c-b0c4791c4eb3 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:30.783649 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-dde3affe-4c43-4de9-b05c-b0c4791c4eb3 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:30.854701 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-dde3affe-4c43-4de9-b05c-b0c4791c4eb3 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1215 microversion: 2.1 time: 0.355721 Sep 05 12:29:30.855406 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 17/32] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:30 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1215 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:30.875663 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f5020665-46f0-4b54-81ec-db3a054886a0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:30.884769 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f5020665-46f0-4b54-81ec-db3a054886a0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:31.593324 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f5020665-46f0-4b54-81ec-db3a054886a0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:31.612920 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f5020665-46f0-4b54-81ec-db3a054886a0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1222 microversion: 2.1 time: 0.755326 Sep 05 12:29:31.615776 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 18/33] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:30 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1222 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:31.826252 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-2d4631e9-8608-4b90-bfac-977c498bee1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-133900132", "imageRef": "7844cf5b-4975-4cb9-a7f8-31cc5e52098a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:31.935575 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.network.neutron [None req-2d4631e9-8608-4b90-bfac-977c498bee1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] validate_networks() for [('adc4bf76-da99-44ec-b79e-0ddca4fe97de', None, None, None, None, None)] {{(pid=121211) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:29:32.069295 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-68488441-ff0d-44aa-892b-e3404b693ab1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Flavor limits 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:29:32.069840 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-68488441-ff0d-44aa-892b-e3404b693ab1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Image limits 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:29:32.070446 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-68488441-ff0d-44aa-892b-e3404b693ab1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Flavor pref 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:29:32.071253 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-68488441-ff0d-44aa-892b-e3404b693ab1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Image pref 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:29:32.071883 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-68488441-ff0d-44aa-892b-e3404b693ab1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:29:32.104672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-68488441-ff0d-44aa-892b-e3404b693ab1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:32.109023 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-68488441-ff0d-44aa-892b-e3404b693ab1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:32.109731 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-68488441-ff0d-44aa-892b-e3404b693ab1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:32.112621 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-68488441-ff0d-44aa-892b-e3404b693ab1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:32.115240 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-68488441-ff0d-44aa-892b-e3404b693ab1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:32.116039 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-68488441-ff0d-44aa-892b-e3404b693ab1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:32.183340 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-68488441-ff0d-44aa-892b-e3404b693ab1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Getting quotas for project 4f6830d2e75a47c8a757d4a66c6695ca. Resources: {'ram', 'instances', 'cores'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:29:32.197608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-68488441-ff0d-44aa-892b-e3404b693ab1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Getting quotas for user de2273220e824339bd13d968c75df26b and project 4f6830d2e75a47c8a757d4a66c6695ca. Resources: {'ram', 'instances', 'cores'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:29:32.223282 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-68488441-ff0d-44aa-892b-e3404b693ab1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Going to run 1 instances... {{(pid=121210) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:29:32.226517 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-68488441-ff0d-44aa-892b-e3404b693ab1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7844cf5b-4975-4cb9-a7f8-31cc5e52098a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:29:32.495841 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-68488441-ff0d-44aa-892b-e3404b693ab1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.778340 Sep 05 12:29:32.498840 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 16/34] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Sep 5 12:29:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 2784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:29:32.511951 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-bd836264-af39-4581-9a12-81a5fed5ac11 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:32.513209 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-bd836264-af39-4581-9a12-81a5fed5ac11 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:32.845128 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-2d4631e9-8608-4b90-bfac-977c498bee1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Flavor limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:29:32.845730 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-2d4631e9-8608-4b90-bfac-977c498bee1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Image limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:29:32.846030 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-2d4631e9-8608-4b90-bfac-977c498bee1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Flavor pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:29:32.846447 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-2d4631e9-8608-4b90-bfac-977c498bee1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Image pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:29:32.846880 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-2d4631e9-8608-4b90-bfac-977c498bee1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:29:32.871695 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2d4631e9-8608-4b90-bfac-977c498bee1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:32.872444 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2d4631e9-8608-4b90-bfac-977c498bee1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:32.873094 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2d4631e9-8608-4b90-bfac-977c498bee1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:32.875164 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2d4631e9-8608-4b90-bfac-977c498bee1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:32.876252 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2d4631e9-8608-4b90-bfac-977c498bee1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:32.878868 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2d4631e9-8608-4b90-bfac-977c498bee1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:32.924895 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-2d4631e9-8608-4b90-bfac-977c498bee1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Getting quotas for project 442bf64c97d945feb79f64cdd66baa28. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:29:32.936064 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-2d4631e9-8608-4b90-bfac-977c498bee1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Getting quotas for user f5543fbd902d441cb6f03d3155f1af8d and project 442bf64c97d945feb79f64cdd66baa28. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:29:32.966553 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-2d4631e9-8608-4b90-bfac-977c498bee1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Going to run 1 instances... {{(pid=121211) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:29:32.984955 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-2d4631e9-8608-4b90-bfac-977c498bee1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7844cf5b-4975-4cb9-a7f8-31cc5e52098a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121211) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:29:33.044105 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-bd836264-af39-4581-9a12-81a5fed5ac11 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:33.068709 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-bd836264-af39-4581-9a12-81a5fed5ac11 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1215 microversion: 2.1 time: 0.568436 Sep 05 12:29:33.071035 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 17/35] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:32 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1215 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:33.089462 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-fef288b8-56ac-403d-9b5d-ac96946e9eec tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:33.092605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-fef288b8-56ac-403d-9b5d-ac96946e9eec tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:33.217164 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-2d4631e9-8608-4b90-bfac-977c498bee1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.403868 Sep 05 12:29:33.218449 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 19/36] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Sep 5 12:29:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 1407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:29:33.228192 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-fef288b8-56ac-403d-9b5d-ac96946e9eec tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:33.237715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-bae51745-90de-4ee0-8b38-e3aac7483155 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:33.241402 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-fef288b8-56ac-403d-9b5d-ac96946e9eec tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1241 microversion: 2.1 time: 0.164582 Sep 05 12:29:33.242369 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-bae51745-90de-4ee0-8b38-e3aac7483155 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:33.244645 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 18/37] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:33 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1241 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:33.427721 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-bae51745-90de-4ee0-8b38-e3aac7483155 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:33.437400 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-bae51745-90de-4ee0-8b38-e3aac7483155 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1221 microversion: 2.1 time: 0.204769 Sep 05 12:29:33.454661 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 20/38] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:33 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1221 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:33.802188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-dd944777-8cf3-493d-b1dd-419ef28f0be6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-156057346", "imageRef": "7844cf5b-4975-4cb9-a7f8-31cc5e52098a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63375a32-83e0-46aa-bf2e-0ee5e39b91e6"}], "security_groups": [{"name": "tempest-securitygroup--279030819"}], "key_name": "tempest-keypair-1164867895", "user_data": "}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:33.984504 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.network.neutron [None req-dd944777-8cf3-493d-b1dd-419ef28f0be6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] validate_networks() for [('63375a32-83e0-46aa-bf2e-0ee5e39b91e6', None, None, None, None, None)] {{(pid=121210) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:29:34.099919 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8b9e19b8-3de5-49a2-9466-b049d4a6dd48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:34.106232 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-8b9e19b8-3de5-49a2-9466-b049d4a6dd48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:34.111201 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8b9e19b8-3de5-49a2-9466-b049d4a6dd48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:34.111721 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8b9e19b8-3de5-49a2-9466-b049d4a6dd48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:34.116137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8b9e19b8-3de5-49a2-9466-b049d4a6dd48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:34.118153 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8b9e19b8-3de5-49a2-9466-b049d4a6dd48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:34.120909 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8b9e19b8-3de5-49a2-9466-b049d4a6dd48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:34.121615 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8b9e19b8-3de5-49a2-9466-b049d4a6dd48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:34.269828 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-8b9e19b8-3de5-49a2-9466-b049d4a6dd48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:34.284948 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-8b9e19b8-3de5-49a2-9466-b049d4a6dd48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1211 microversion: 2.1 time: 0.190444 Sep 05 12:29:34.285719 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 21/39] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:34 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1211 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:29:34.290832 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d000f42b-61e1-4f21-92fa-a9bbc18e6a32 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:34.291778 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d000f42b-61e1-4f21-92fa-a9bbc18e6a32 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:34.412626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d000f42b-61e1-4f21-92fa-a9bbc18e6a32 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:34.437821 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d000f42b-61e1-4f21-92fa-a9bbc18e6a32 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1241 microversion: 2.1 time: 0.150376 Sep 05 12:29:34.441063 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 22/40] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:34 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1241 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:34.466714 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4313a12b-33ff-4f26-a123-9695eedfe2ab tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:34.467650 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4313a12b-33ff-4f26-a123-9695eedfe2ab tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:34.529938 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-4313a12b-33ff-4f26-a123-9695eedfe2ab tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:34.536852 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4313a12b-33ff-4f26-a123-9695eedfe2ab tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1221 microversion: 2.1 time: 0.075732 Sep 05 12:29:34.537421 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 23/41] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:34 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1221 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:29:34.633727 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-dd944777-8cf3-493d-b1dd-419ef28f0be6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Flavor limits 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:29:34.633727 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-dd944777-8cf3-493d-b1dd-419ef28f0be6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Image limits 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:29:34.633727 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-dd944777-8cf3-493d-b1dd-419ef28f0be6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Flavor pref 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:29:34.633727 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-dd944777-8cf3-493d-b1dd-419ef28f0be6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Image pref 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:29:34.633727 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-dd944777-8cf3-493d-b1dd-419ef28f0be6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:29:34.645454 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-dd944777-8cf3-493d-b1dd-419ef28f0be6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:34.646753 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-dd944777-8cf3-493d-b1dd-419ef28f0be6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:34.647731 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-dd944777-8cf3-493d-b1dd-419ef28f0be6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:34.648693 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-dd944777-8cf3-493d-b1dd-419ef28f0be6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:34.649290 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-dd944777-8cf3-493d-b1dd-419ef28f0be6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:34.649994 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-dd944777-8cf3-493d-b1dd-419ef28f0be6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:34.675625 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-dd944777-8cf3-493d-b1dd-419ef28f0be6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Getting quotas for project 094bae935a1e4738b0c51d33c6d89e3a. Resources: {'ram', 'instances', 'cores'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:29:34.684822 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-dd944777-8cf3-493d-b1dd-419ef28f0be6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Getting quotas for user 9a61a18900c44bea89647fc9ccdaf110 and project 094bae935a1e4738b0c51d33c6d89e3a. Resources: {'ram', 'instances', 'cores'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:29:34.713799 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-dd944777-8cf3-493d-b1dd-419ef28f0be6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Going to run 1 instances... {{(pid=121210) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:29:34.715976 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-dd944777-8cf3-493d-b1dd-419ef28f0be6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7844cf5b-4975-4cb9-a7f8-31cc5e52098a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:29:34.939134 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-dd944777-8cf3-493d-b1dd-419ef28f0be6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.141241 Sep 05 12:29:34.940156 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 19/42] 10.222.0.62 () {62 vars in 1188 bytes} [Mon Sep 5 12:29:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 05 12:29:34.953240 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-60d7184b-32ee-481f-830a-c1f5527a241d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:34.953860 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-60d7184b-32ee-481f-830a-c1f5527a241d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:35.029402 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-60d7184b-32ee-481f-830a-c1f5527a241d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:35.038978 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-60d7184b-32ee-481f-830a-c1f5527a241d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:35.040945 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-60d7184b-32ee-481f-830a-c1f5527a241d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:35.042193 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-60d7184b-32ee-481f-830a-c1f5527a241d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1281 microversion: 2.20 time: 0.093089 Sep 05 12:29:35.043235 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 24/43] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:34 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1281 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:35.311640 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-9e92956e-0a7a-4ebd-a745-6e7cf714112d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:35.312401 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-9e92956e-0a7a-4ebd-a745-6e7cf714112d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:35.320057 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9e92956e-0a7a-4ebd-a745-6e7cf714112d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:35.320783 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9e92956e-0a7a-4ebd-a745-6e7cf714112d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:35.321284 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9e92956e-0a7a-4ebd-a745-6e7cf714112d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:35.322046 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9e92956e-0a7a-4ebd-a745-6e7cf714112d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:35.322495 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9e92956e-0a7a-4ebd-a745-6e7cf714112d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:35.323069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9e92956e-0a7a-4ebd-a745-6e7cf714112d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:35.466510 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-27964130-5c9a-4369-a734-54ee5b45456e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:35.468803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-27964130-5c9a-4369-a734-54ee5b45456e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:35.501542 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-27964130-5c9a-4369-a734-54ee5b45456e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:35.502949 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-27964130-5c9a-4369-a734-54ee5b45456e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:35.505987 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-27964130-5c9a-4369-a734-54ee5b45456e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:35.507838 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-27964130-5c9a-4369-a734-54ee5b45456e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:35.508698 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-27964130-5c9a-4369-a734-54ee5b45456e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:35.509989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-27964130-5c9a-4369-a734-54ee5b45456e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:35.512816 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-9e92956e-0a7a-4ebd-a745-6e7cf714112d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:35.534699 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-9e92956e-0a7a-4ebd-a745-6e7cf714112d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1267 microversion: 2.1 time: 0.226943 Sep 05 12:29:35.535633 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 20/44] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:35 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:35.560144 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-289b7dcb-bf33-4615-adde-1f3fb9cfc083 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:35.560825 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-289b7dcb-bf33-4615-adde-1f3fb9cfc083 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:35.576585 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-289b7dcb-bf33-4615-adde-1f3fb9cfc083 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:35.579262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-289b7dcb-bf33-4615-adde-1f3fb9cfc083 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:35.579904 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-289b7dcb-bf33-4615-adde-1f3fb9cfc083 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:35.580779 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-289b7dcb-bf33-4615-adde-1f3fb9cfc083 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:35.582929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-289b7dcb-bf33-4615-adde-1f3fb9cfc083 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:35.585204 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-289b7dcb-bf33-4615-adde-1f3fb9cfc083 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:35.649731 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-27964130-5c9a-4369-a734-54ee5b45456e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:35.666254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-27964130-5c9a-4369-a734-54ee5b45456e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1237 microversion: 2.1 time: 0.202432 Sep 05 12:29:35.680290 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 25/45] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:35 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1237 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:35.703152 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-289b7dcb-bf33-4615-adde-1f3fb9cfc083 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:35.711939 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-289b7dcb-bf33-4615-adde-1f3fb9cfc083 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1225 microversion: 2.1 time: 0.155593 Sep 05 12:29:35.724070 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 21/46] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:35 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1225 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:36.073925 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-496be980-37b5-4849-a4a7-cc2a6011a21f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:36.075278 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-496be980-37b5-4849-a4a7-cc2a6011a21f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:36.268019 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-496be980-37b5-4849-a4a7-cc2a6011a21f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:36.276791 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-496be980-37b5-4849-a4a7-cc2a6011a21f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:36.300540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-496be980-37b5-4849-a4a7-cc2a6011a21f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:36.301987 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-496be980-37b5-4849-a4a7-cc2a6011a21f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1281 microversion: 2.20 time: 0.236257 Sep 05 12:29:36.302571 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 26/47] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:36 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1281 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:36.558346 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-b9f6b5cb-4ef2-4eec-9226-b5c230f4fa93 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:36.559337 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-b9f6b5cb-4ef2-4eec-9226-b5c230f4fa93 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:36.576053 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b9f6b5cb-4ef2-4eec-9226-b5c230f4fa93 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:36.576548 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b9f6b5cb-4ef2-4eec-9226-b5c230f4fa93 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:36.576979 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b9f6b5cb-4ef2-4eec-9226-b5c230f4fa93 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:36.577764 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b9f6b5cb-4ef2-4eec-9226-b5c230f4fa93 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:36.578246 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b9f6b5cb-4ef2-4eec-9226-b5c230f4fa93 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:36.578663 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b9f6b5cb-4ef2-4eec-9226-b5c230f4fa93 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:36.655975 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-b9f6b5cb-4ef2-4eec-9226-b5c230f4fa93 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:36.666915 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-b9f6b5cb-4ef2-4eec-9226-b5c230f4fa93 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1285 microversion: 2.1 time: 0.109861 Sep 05 12:29:36.672329 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 22/48] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:36 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:36.705701 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d0c41d61-846a-468b-acec-3e5b5b96ae4e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:36.707030 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d0c41d61-846a-468b-acec-3e5b5b96ae4e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:36.722193 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d0c41d61-846a-468b-acec-3e5b5b96ae4e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:36.722691 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d0c41d61-846a-468b-acec-3e5b5b96ae4e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:36.723129 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d0c41d61-846a-468b-acec-3e5b5b96ae4e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:36.725910 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d0c41d61-846a-468b-acec-3e5b5b96ae4e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:36.733407 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d0c41d61-846a-468b-acec-3e5b5b96ae4e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:36.734037 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d0c41d61-846a-468b-acec-3e5b5b96ae4e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:36.740365 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-44f25c4f-020d-4264-b910-bf091621e985 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:36.741056 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-44f25c4f-020d-4264-b910-bf091621e985 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:36.756896 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-44f25c4f-020d-4264-b910-bf091621e985 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:36.757712 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-44f25c4f-020d-4264-b910-bf091621e985 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:36.759358 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-44f25c4f-020d-4264-b910-bf091621e985 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:36.762193 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-44f25c4f-020d-4264-b910-bf091621e985 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:36.762896 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-44f25c4f-020d-4264-b910-bf091621e985 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:36.765364 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-44f25c4f-020d-4264-b910-bf091621e985 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:37.003977 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-44f25c4f-020d-4264-b910-bf091621e985 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:37.015649 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-44f25c4f-020d-4264-b910-bf091621e985 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1273 microversion: 2.1 time: 0.281738 Sep 05 12:29:37.028033 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 23/49] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:36 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1273 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:29:37.087715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d0c41d61-846a-468b-acec-3e5b5b96ae4e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:37.097763 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d0c41d61-846a-468b-acec-3e5b5b96ae4e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1293 microversion: 2.1 time: 0.405247 Sep 05 12:29:37.100465 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 27/50] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:36 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1293 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:37.349515 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-263d7824-5a1e-4806-bcdf-723b617851d4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:37.351957 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-263d7824-5a1e-4806-bcdf-723b617851d4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:37.376615 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-263d7824-5a1e-4806-bcdf-723b617851d4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:37.383243 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-263d7824-5a1e-4806-bcdf-723b617851d4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:37.383788 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-263d7824-5a1e-4806-bcdf-723b617851d4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:37.384548 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-263d7824-5a1e-4806-bcdf-723b617851d4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:37.393884 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-263d7824-5a1e-4806-bcdf-723b617851d4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:37.394361 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-263d7824-5a1e-4806-bcdf-723b617851d4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:37.537014 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-263d7824-5a1e-4806-bcdf-723b617851d4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:37.553119 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-263d7824-5a1e-4806-bcdf-723b617851d4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:37.575475 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-263d7824-5a1e-4806-bcdf-723b617851d4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:37.580126 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-263d7824-5a1e-4806-bcdf-723b617851d4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1285 microversion: 2.20 time: 0.242006 Sep 05 12:29:37.583628 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 24/51] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:37 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1285 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:37.687137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f286441e-dce0-4be3-bbde-56ab2cd359d8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:37.687776 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f286441e-dce0-4be3-bbde-56ab2cd359d8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:37.697770 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f286441e-dce0-4be3-bbde-56ab2cd359d8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:37.698558 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f286441e-dce0-4be3-bbde-56ab2cd359d8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:37.699630 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f286441e-dce0-4be3-bbde-56ab2cd359d8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:37.700976 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f286441e-dce0-4be3-bbde-56ab2cd359d8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:37.701651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f286441e-dce0-4be3-bbde-56ab2cd359d8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:37.702079 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f286441e-dce0-4be3-bbde-56ab2cd359d8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:37.875107 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f286441e-dce0-4be3-bbde-56ab2cd359d8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:37.884798 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f286441e-dce0-4be3-bbde-56ab2cd359d8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1273 microversion: 2.1 time: 0.202097 Sep 05 12:29:37.885442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 28/52] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:37 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1273 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:38.053571 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-c7d7f3ab-5c03-4f8f-a40e-f489fd48220f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:38.053935 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-c7d7f3ab-5c03-4f8f-a40e-f489fd48220f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:38.070376 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c7d7f3ab-5c03-4f8f-a40e-f489fd48220f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:38.071191 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c7d7f3ab-5c03-4f8f-a40e-f489fd48220f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:38.076968 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c7d7f3ab-5c03-4f8f-a40e-f489fd48220f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:38.078062 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c7d7f3ab-5c03-4f8f-a40e-f489fd48220f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:38.078694 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c7d7f3ab-5c03-4f8f-a40e-f489fd48220f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:38.079512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c7d7f3ab-5c03-4f8f-a40e-f489fd48220f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:38.125818 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3654adf2-da57-423a-b6ba-bc551b7a1253 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:38.126657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-3654adf2-da57-423a-b6ba-bc551b7a1253 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:38.151891 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3654adf2-da57-423a-b6ba-bc551b7a1253 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:38.151891 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3654adf2-da57-423a-b6ba-bc551b7a1253 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:38.151891 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3654adf2-da57-423a-b6ba-bc551b7a1253 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:38.151891 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3654adf2-da57-423a-b6ba-bc551b7a1253 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:38.152325 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3654adf2-da57-423a-b6ba-bc551b7a1253 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:38.152325 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3654adf2-da57-423a-b6ba-bc551b7a1253 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:38.354618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c7d7f3ab-5c03-4f8f-a40e-f489fd48220f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:38.369319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-c7d7f3ab-5c03-4f8f-a40e-f489fd48220f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1281 microversion: 2.1 time: 0.327099 Sep 05 12:29:38.371278 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 25/53] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:38 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1281 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:38.410200 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3654adf2-da57-423a-b6ba-bc551b7a1253 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:38.423738 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3654adf2-da57-423a-b6ba-bc551b7a1253 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1311 microversion: 2.1 time: 0.300377 Sep 05 12:29:38.427362 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 29/54] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:38 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1311 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:38.614779 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-daecde21-b239-40c0-94bd-0d13c9903b46 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:38.615906 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-daecde21-b239-40c0-94bd-0d13c9903b46 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:38.626223 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-daecde21-b239-40c0-94bd-0d13c9903b46 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:38.633197 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-daecde21-b239-40c0-94bd-0d13c9903b46 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:38.634301 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-daecde21-b239-40c0-94bd-0d13c9903b46 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:38.637271 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-daecde21-b239-40c0-94bd-0d13c9903b46 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:38.640243 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-daecde21-b239-40c0-94bd-0d13c9903b46 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:38.640701 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-daecde21-b239-40c0-94bd-0d13c9903b46 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:38.914709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-da9ca56e-43b8-4a90-b7c4-4ddc0dd8954c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:38.916102 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-da9ca56e-43b8-4a90-b7c4-4ddc0dd8954c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:38.932772 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-da9ca56e-43b8-4a90-b7c4-4ddc0dd8954c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:38.933207 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-da9ca56e-43b8-4a90-b7c4-4ddc0dd8954c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:38.933657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-da9ca56e-43b8-4a90-b7c4-4ddc0dd8954c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:38.936465 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-da9ca56e-43b8-4a90-b7c4-4ddc0dd8954c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:38.936962 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-da9ca56e-43b8-4a90-b7c4-4ddc0dd8954c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:38.937417 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-da9ca56e-43b8-4a90-b7c4-4ddc0dd8954c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:39.205613 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-daecde21-b239-40c0-94bd-0d13c9903b46 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:39.214577 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-daecde21-b239-40c0-94bd-0d13c9903b46 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:39.219879 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-daecde21-b239-40c0-94bd-0d13c9903b46 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:39.223252 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-daecde21-b239-40c0-94bd-0d13c9903b46 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1333 microversion: 2.20 time: 0.613147 Sep 05 12:29:39.226829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 26/55] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:38 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1333 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:39.399302 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-2265e632-6e8e-41ba-b187-14caa3f0f869 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:39.402820 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-2265e632-6e8e-41ba-b187-14caa3f0f869 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:39.433896 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2265e632-6e8e-41ba-b187-14caa3f0f869 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:39.443999 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2265e632-6e8e-41ba-b187-14caa3f0f869 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:39.448840 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2265e632-6e8e-41ba-b187-14caa3f0f869 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:39.449433 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2265e632-6e8e-41ba-b187-14caa3f0f869 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:39.451059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2265e632-6e8e-41ba-b187-14caa3f0f869 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:39.458244 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2265e632-6e8e-41ba-b187-14caa3f0f869 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:39.681022 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-2265e632-6e8e-41ba-b187-14caa3f0f869 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:39.725468 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-2265e632-6e8e-41ba-b187-14caa3f0f869 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1279 microversion: 2.1 time: 0.332980 Sep 05 12:29:39.729568 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 27/56] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:39 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1279 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:39.747997 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1ca40825-ec5e-4ce7-a874-278e8d8eb55e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:39.752580 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1ca40825-ec5e-4ce7-a874-278e8d8eb55e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:39.774566 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1ca40825-ec5e-4ce7-a874-278e8d8eb55e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:39.785117 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1ca40825-ec5e-4ce7-a874-278e8d8eb55e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:39.789908 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1ca40825-ec5e-4ce7-a874-278e8d8eb55e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:39.793836 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1ca40825-ec5e-4ce7-a874-278e8d8eb55e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:39.806243 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1ca40825-ec5e-4ce7-a874-278e8d8eb55e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:39.808217 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1ca40825-ec5e-4ce7-a874-278e8d8eb55e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:39.870089 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-da9ca56e-43b8-4a90-b7c4-4ddc0dd8954c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:39.892896 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-da9ca56e-43b8-4a90-b7c4-4ddc0dd8954c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1315 microversion: 2.1 time: 0.983920 Sep 05 12:29:39.896417 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 30/57] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:38 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1315 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:40.103474 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1ca40825-ec5e-4ce7-a874-278e8d8eb55e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:40.121345 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1ca40825-ec5e-4ce7-a874-278e8d8eb55e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1299 microversion: 2.1 time: 0.387109 Sep 05 12:29:40.147462 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 28/58] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:39 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1299 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:40.278492 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7cfd4883-3a86-4e67-9788-473b65a5c3f9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:40.278492 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-7cfd4883-3a86-4e67-9788-473b65a5c3f9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:40.278492 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7cfd4883-3a86-4e67-9788-473b65a5c3f9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:40.278492 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7cfd4883-3a86-4e67-9788-473b65a5c3f9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:40.279422 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7cfd4883-3a86-4e67-9788-473b65a5c3f9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:40.279422 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7cfd4883-3a86-4e67-9788-473b65a5c3f9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:40.280200 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7cfd4883-3a86-4e67-9788-473b65a5c3f9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:40.280200 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7cfd4883-3a86-4e67-9788-473b65a5c3f9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:40.468128 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-7cfd4883-3a86-4e67-9788-473b65a5c3f9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:40.484861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-7cfd4883-3a86-4e67-9788-473b65a5c3f9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:40.486323 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-7cfd4883-3a86-4e67-9788-473b65a5c3f9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:40.487430 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-7cfd4883-3a86-4e67-9788-473b65a5c3f9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1341 microversion: 2.20 time: 0.227200 Sep 05 12:29:40.488039 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 31/59] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:40 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1341 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:40.754899 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-6c4345e7-197b-45c2-811e-23c42820a4f5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:40.755332 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-6c4345e7-197b-45c2-811e-23c42820a4f5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:40.769781 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6c4345e7-197b-45c2-811e-23c42820a4f5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:40.779343 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6c4345e7-197b-45c2-811e-23c42820a4f5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:40.779343 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6c4345e7-197b-45c2-811e-23c42820a4f5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:40.779514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6c4345e7-197b-45c2-811e-23c42820a4f5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:40.780182 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6c4345e7-197b-45c2-811e-23c42820a4f5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:40.781466 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6c4345e7-197b-45c2-811e-23c42820a4f5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:40.927706 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8b960477-a7d7-48fc-986e-d7a175192b12 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:40.928970 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-8b960477-a7d7-48fc-986e-d7a175192b12 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:40.939947 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:40.941747 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8b960477-a7d7-48fc-986e-d7a175192b12 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:40.942885 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8b960477-a7d7-48fc-986e-d7a175192b12 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:40.943419 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8b960477-a7d7-48fc-986e-d7a175192b12 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:40.944584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8b960477-a7d7-48fc-986e-d7a175192b12 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:40.949316 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8b960477-a7d7-48fc-986e-d7a175192b12 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:40.949861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8b960477-a7d7-48fc-986e-d7a175192b12 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:41.187865 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6c4345e7-197b-45c2-811e-23c42820a4f5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:41.199343 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-6c4345e7-197b-45c2-811e-23c42820a4f5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1279 microversion: 2.1 time: 0.449124 Sep 05 12:29:41.209739 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 29/60] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:40 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1279 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:41.226447 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-5bb6dda0-dca4-44fc-9b26-689dacfcf0c1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:41.235378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-5bb6dda0-dca4-44fc-9b26-689dacfcf0c1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:41.251241 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5bb6dda0-dca4-44fc-9b26-689dacfcf0c1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:41.251846 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5bb6dda0-dca4-44fc-9b26-689dacfcf0c1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:41.256557 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5bb6dda0-dca4-44fc-9b26-689dacfcf0c1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:41.257522 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5bb6dda0-dca4-44fc-9b26-689dacfcf0c1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:41.258108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5bb6dda0-dca4-44fc-9b26-689dacfcf0c1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:41.258706 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5bb6dda0-dca4-44fc-9b26-689dacfcf0c1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:41.790907 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-5bb6dda0-dca4-44fc-9b26-689dacfcf0c1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:41.806714 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-5bb6dda0-dca4-44fc-9b26-689dacfcf0c1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1367 microversion: 2.1 time: 0.595349 Sep 05 12:29:41.811351 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 30/61] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:41 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1367 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:41.843485 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-6caad862-ab1d-4269-a765-9740ab508a70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:41.847924 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-6caad862-ab1d-4269-a765-9740ab508a70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:41.867364 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6caad862-ab1d-4269-a765-9740ab508a70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:41.868153 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6caad862-ab1d-4269-a765-9740ab508a70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:41.868765 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6caad862-ab1d-4269-a765-9740ab508a70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:41.870335 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6caad862-ab1d-4269-a765-9740ab508a70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:41.871967 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6caad862-ab1d-4269-a765-9740ab508a70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:41.873865 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6caad862-ab1d-4269-a765-9740ab508a70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:42.008775 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6caad862-ab1d-4269-a765-9740ab508a70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:42.021299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6caad862-ab1d-4269-a765-9740ab508a70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:42.026230 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6caad862-ab1d-4269-a765-9740ab508a70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:42.030471 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-6caad862-ab1d-4269-a765-9740ab508a70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1339 microversion: 2.20 time: 0.215838 Sep 05 12:29:42.038034 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 31/62] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:41 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1339 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:42.234233 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-93ec1d1d-989c-4416-bcce-1a19457afe2a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:42.235763 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-93ec1d1d-989c-4416-bcce-1a19457afe2a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:42.255863 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-93ec1d1d-989c-4416-bcce-1a19457afe2a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:42.256935 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-93ec1d1d-989c-4416-bcce-1a19457afe2a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:42.257731 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-93ec1d1d-989c-4416-bcce-1a19457afe2a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:42.258915 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-93ec1d1d-989c-4416-bcce-1a19457afe2a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:42.259726 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-93ec1d1d-989c-4416-bcce-1a19457afe2a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:42.260661 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-93ec1d1d-989c-4416-bcce-1a19457afe2a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:42.352619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-8b960477-a7d7-48fc-986e-d7a175192b12 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:42.362109 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-8b960477-a7d7-48fc-986e-d7a175192b12 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1315 microversion: 2.1 time: 1.440598 Sep 05 12:29:42.362962 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 32/63] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:40 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1315 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:42.844315 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7a67823f-5f54-41bc-bf5b-59e483acf00d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:42.847754 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-7a67823f-5f54-41bc-bf5b-59e483acf00d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:42.872565 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7a67823f-5f54-41bc-bf5b-59e483acf00d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:42.882926 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7a67823f-5f54-41bc-bf5b-59e483acf00d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:42.884906 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7a67823f-5f54-41bc-bf5b-59e483acf00d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:42.886002 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7a67823f-5f54-41bc-bf5b-59e483acf00d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:42.886673 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7a67823f-5f54-41bc-bf5b-59e483acf00d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:42.887355 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7a67823f-5f54-41bc-bf5b-59e483acf00d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:42.909413 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=4 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:42.912808 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-93ec1d1d-989c-4416-bcce-1a19457afe2a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:42.927678 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-93ec1d1d-989c-4416-bcce-1a19457afe2a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.697561 Sep 05 12:29:42.931990 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 32/64] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:42 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:43.061590 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-5749b1ed-f646-442d-b807-4bca0a0ed1a0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:43.063237 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-5749b1ed-f646-442d-b807-4bca0a0ed1a0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:43.073681 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5749b1ed-f646-442d-b807-4bca0a0ed1a0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:43.074746 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5749b1ed-f646-442d-b807-4bca0a0ed1a0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:43.075463 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5749b1ed-f646-442d-b807-4bca0a0ed1a0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:43.077138 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5749b1ed-f646-442d-b807-4bca0a0ed1a0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:43.077952 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5749b1ed-f646-442d-b807-4bca0a0ed1a0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:43.078662 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5749b1ed-f646-442d-b807-4bca0a0ed1a0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:43.329750 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-5749b1ed-f646-442d-b807-4bca0a0ed1a0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:43.347268 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-5749b1ed-f646-442d-b807-4bca0a0ed1a0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:43.349980 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-5749b1ed-f646-442d-b807-4bca0a0ed1a0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:43.353520 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-5749b1ed-f646-442d-b807-4bca0a0ed1a0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1339 microversion: 2.20 time: 0.296334 Sep 05 12:29:43.357312 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 33/65] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:43 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1339 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:29:43.392493 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-6bb4350a-2876-4b14-9aab-be93c8e14295 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:43.394099 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-6bb4350a-2876-4b14-9aab-be93c8e14295 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:43.410013 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6bb4350a-2876-4b14-9aab-be93c8e14295 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:43.410506 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6bb4350a-2876-4b14-9aab-be93c8e14295 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:43.411477 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6bb4350a-2876-4b14-9aab-be93c8e14295 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:43.423527 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6bb4350a-2876-4b14-9aab-be93c8e14295 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:43.424031 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6bb4350a-2876-4b14-9aab-be93c8e14295 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:43.427491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6bb4350a-2876-4b14-9aab-be93c8e14295 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:43.945627 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6bb4350a-2876-4b14-9aab-be93c8e14295 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:43.964572 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-6bb4350a-2876-4b14-9aab-be93c8e14295 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1315 microversion: 2.1 time: 0.576239 Sep 05 12:29:43.968398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 34/66] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:43 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1315 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:29:43.979123 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-b5328b0d-b48f-4c2f-b92c-9b6d6f41bcda tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:43.981391 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-b5328b0d-b48f-4c2f-b92c-9b6d6f41bcda tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:43.999476 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b5328b0d-b48f-4c2f-b92c-9b6d6f41bcda tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:44.000008 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b5328b0d-b48f-4c2f-b92c-9b6d6f41bcda tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:44.000439 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b5328b0d-b48f-4c2f-b92c-9b6d6f41bcda tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:44.014720 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b5328b0d-b48f-4c2f-b92c-9b6d6f41bcda tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:44.014720 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b5328b0d-b48f-4c2f-b92c-9b6d6f41bcda tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:44.014720 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b5328b0d-b48f-4c2f-b92c-9b6d6f41bcda tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:44.078908 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=100 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:44.234248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-7a67823f-5f54-41bc-bf5b-59e483acf00d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:44.274702 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-7a67823f-5f54-41bc-bf5b-59e483acf00d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1367 microversion: 2.1 time: 1.444004 Sep 05 12:29:44.284859 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 33/67] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:42 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1367 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:44.389213 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1b031d7b-2502-49fc-a946-7bad4e6a4251 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:44.398587 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1b031d7b-2502-49fc-a946-7bad4e6a4251 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:44.398587 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b031d7b-2502-49fc-a946-7bad4e6a4251 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:44.398587 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b031d7b-2502-49fc-a946-7bad4e6a4251 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:44.412429 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b031d7b-2502-49fc-a946-7bad4e6a4251 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:44.415290 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b031d7b-2502-49fc-a946-7bad4e6a4251 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:44.415845 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b031d7b-2502-49fc-a946-7bad4e6a4251 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:44.416366 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b031d7b-2502-49fc-a946-7bad4e6a4251 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:44.587240 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-b5328b0d-b48f-4c2f-b92c-9b6d6f41bcda tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:44.595910 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-b5328b0d-b48f-4c2f-b92c-9b6d6f41bcda tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.626195 Sep 05 12:29:44.596533 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 35/68] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:43 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:44.998375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7a100cb8-c8bd-4f43-afed-e7021904f4ed tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:44.999230 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-7a100cb8-c8bd-4f43-afed-e7021904f4ed tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:45.013421 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=6 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:45.013421 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=22 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:45.026869 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7a100cb8-c8bd-4f43-afed-e7021904f4ed tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:45.027513 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7a100cb8-c8bd-4f43-afed-e7021904f4ed tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:45.027890 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7a100cb8-c8bd-4f43-afed-e7021904f4ed tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:45.081838 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7a100cb8-c8bd-4f43-afed-e7021904f4ed tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:45.086025 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7a100cb8-c8bd-4f43-afed-e7021904f4ed tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:45.088765 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7a100cb8-c8bd-4f43-afed-e7021904f4ed tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:45.415131 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1b031d7b-2502-49fc-a946-7bad4e6a4251 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:45.431062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1b031d7b-2502-49fc-a946-7bad4e6a4251 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:45.433095 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1b031d7b-2502-49fc-a946-7bad4e6a4251 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:45.434611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1b031d7b-2502-49fc-a946-7bad4e6a4251 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1406 microversion: 2.20 time: 1.049773 Sep 05 12:29:45.440136 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 34/69] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:44 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1406 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:29:45.476475 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1b177e9f-a7ca-438c-8e5d-0b414049dfea tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:45.477208 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1b177e9f-a7ca-438c-8e5d-0b414049dfea tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:45.484366 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b177e9f-a7ca-438c-8e5d-0b414049dfea tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:45.489837 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b177e9f-a7ca-438c-8e5d-0b414049dfea tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:45.490399 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b177e9f-a7ca-438c-8e5d-0b414049dfea tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:45.491299 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b177e9f-a7ca-438c-8e5d-0b414049dfea tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:45.491852 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b177e9f-a7ca-438c-8e5d-0b414049dfea tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:45.492383 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b177e9f-a7ca-438c-8e5d-0b414049dfea tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:45.638733 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-7a100cb8-c8bd-4f43-afed-e7021904f4ed tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:45.658276 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-7a100cb8-c8bd-4f43-afed-e7021904f4ed tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1315 microversion: 2.1 time: 0.660191 Sep 05 12:29:45.680665 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 36/70] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:44 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1315 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:45.703359 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1eb3a609-9c3a-4799-aefd-6f3cfa45adbc tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:45.704414 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1eb3a609-9c3a-4799-aefd-6f3cfa45adbc tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:45.720898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1eb3a609-9c3a-4799-aefd-6f3cfa45adbc tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:45.721994 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1eb3a609-9c3a-4799-aefd-6f3cfa45adbc tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:45.722644 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1eb3a609-9c3a-4799-aefd-6f3cfa45adbc tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:45.723634 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1eb3a609-9c3a-4799-aefd-6f3cfa45adbc tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:45.727935 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1eb3a609-9c3a-4799-aefd-6f3cfa45adbc tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:45.728685 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1eb3a609-9c3a-4799-aefd-6f3cfa45adbc tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:45.862972 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1b177e9f-a7ca-438c-8e5d-0b414049dfea tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:45.896849 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1b177e9f-a7ca-438c-8e5d-0b414049dfea tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1367 microversion: 2.1 time: 0.443609 Sep 05 12:29:45.898890 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 35/71] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:45 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1367 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:46.078331 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-bec10c03-9394-4bf5-9cd7-3733a039adc8 req-e34c23ce-d0dc-44c6-a283-1ff68f3e4ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83fdb4c3-ab13-406e-8f5c-a8a7e481374f", "tag": "5d2944c4-c65b-49e5-b532-6867e3db6d0c"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:46.092319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-bec10c03-9394-4bf5-9cd7-3733a039adc8 req-e34c23ce-d0dc-44c6-a283-1ff68f3e4ac4 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:46.093006 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-bec10c03-9394-4bf5-9cd7-3733a039adc8 req-e34c23ce-d0dc-44c6-a283-1ff68f3e4ac4 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:46.093575 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-bec10c03-9394-4bf5-9cd7-3733a039adc8 req-e34c23ce-d0dc-44c6-a283-1ff68f3e4ac4 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:46.122357 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-bec10c03-9394-4bf5-9cd7-3733a039adc8 req-e34c23ce-d0dc-44c6-a283-1ff68f3e4ac4 service nova] Creating event network-changed:5d2944c4-c65b-49e5-b532-6867e3db6d0c for instance 83fdb4c3-ab13-406e-8f5c-a8a7e481374f on hv-cinder-80135 Sep 05 12:29:46.123049 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-bec10c03-9394-4bf5-9cd7-3733a039adc8 req-e34c23ce-d0dc-44c6-a283-1ff68f3e4ac4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121211) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 05 12:29:46.123603 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-bec10c03-9394-4bf5-9cd7-3733a039adc8 req-e34c23ce-d0dc-44c6-a283-1ff68f3e4ac4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121211) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 05 12:29:46.125476 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0d5d92ec-3ba3-4381-b6a9-abe08f698b43 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:46.126100 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0d5d92ec-3ba3-4381-b6a9-abe08f698b43 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:46.127322 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0d5d92ec-3ba3-4381-b6a9-abe08f698b43 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:46.128565 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0d5d92ec-3ba3-4381-b6a9-abe08f698b43 None None] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:46.129275 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0d5d92ec-3ba3-4381-b6a9-abe08f698b43 None None] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:46.130358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0d5d92ec-3ba3-4381-b6a9-abe08f698b43 None None] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:46.143902 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.compute.rpcapi [None req-0d5d92ec-3ba3-4381-b6a9-abe08f698b43 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 05 12:29:46.145259 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0d5d92ec-3ba3-4381-b6a9-abe08f698b43 None None] Releasing lock "compute-rpcapi-router" {{(pid=121211) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 05 12:29:46.167225 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0d5d92ec-3ba3-4381-b6a9-abe08f698b43 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173900 Sep 05 12:29:46.167962 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 36/72] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:46.186520 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1eb3a609-9c3a-4799-aefd-6f3cfa45adbc tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:46.195128 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1eb3a609-9c3a-4799-aefd-6f3cfa45adbc tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.523935 Sep 05 12:29:46.196842 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 37/73] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:45 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:46.237929 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-24a397a7-36ae-450b-9d9c-12fffbb01898 req-30054604-e46a-4d4c-a238-3399457163f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2", "tag": "2941d715-09fe-449b-bed5-764f516010b2"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:46.247881 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-24a397a7-36ae-450b-9d9c-12fffbb01898 req-30054604-e46a-4d4c-a238-3399457163f3 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:46.248348 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-24a397a7-36ae-450b-9d9c-12fffbb01898 req-30054604-e46a-4d4c-a238-3399457163f3 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:46.248768 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-24a397a7-36ae-450b-9d9c-12fffbb01898 req-30054604-e46a-4d4c-a238-3399457163f3 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:46.259701 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-24a397a7-36ae-450b-9d9c-12fffbb01898 req-30054604-e46a-4d4c-a238-3399457163f3 service nova] Creating event network-changed:2941d715-09fe-449b-bed5-764f516010b2 for instance f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 on hv-cinder-80135 Sep 05 12:29:46.266609 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-24a397a7-36ae-450b-9d9c-12fffbb01898 req-30054604-e46a-4d4c-a238-3399457163f3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095097 Sep 05 12:29:46.266609 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 37/74] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:46.472078 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-c0b74604-74ad-4bdc-82d4-3fc1dd917058 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:46.472765 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-c0b74604-74ad-4bdc-82d4-3fc1dd917058 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:46.480843 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c0b74604-74ad-4bdc-82d4-3fc1dd917058 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:46.481335 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c0b74604-74ad-4bdc-82d4-3fc1dd917058 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:46.481765 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c0b74604-74ad-4bdc-82d4-3fc1dd917058 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:46.482830 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c0b74604-74ad-4bdc-82d4-3fc1dd917058 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:46.483379 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c0b74604-74ad-4bdc-82d4-3fc1dd917058 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:46.483833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c0b74604-74ad-4bdc-82d4-3fc1dd917058 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:46.652331 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c0b74604-74ad-4bdc-82d4-3fc1dd917058 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:46.658908 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c0b74604-74ad-4bdc-82d4-3fc1dd917058 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:46.660684 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c0b74604-74ad-4bdc-82d4-3fc1dd917058 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:46.662405 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-c0b74604-74ad-4bdc-82d4-3fc1dd917058 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1406 microversion: 2.20 time: 0.194494 Sep 05 12:29:46.663303 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 38/75] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:46 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:46.695704 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c3fb0890-9f3b-4903-b5c4-88ba76846cad tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:46.696386 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-c3fb0890-9f3b-4903-b5c4-88ba76846cad tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:46.701407 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=34 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:46.704049 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c3fb0890-9f3b-4903-b5c4-88ba76846cad tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:46.704495 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c3fb0890-9f3b-4903-b5c4-88ba76846cad tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:46.704931 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c3fb0890-9f3b-4903-b5c4-88ba76846cad tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:46.705628 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c3fb0890-9f3b-4903-b5c4-88ba76846cad tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:46.706241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c3fb0890-9f3b-4903-b5c4-88ba76846cad tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:46.706671 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c3fb0890-9f3b-4903-b5c4-88ba76846cad tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:46.886976 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c3fb0890-9f3b-4903-b5c4-88ba76846cad tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:46.895247 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-c3fb0890-9f3b-4903-b5c4-88ba76846cad tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1315 microversion: 2.1 time: 0.204763 Sep 05 12:29:46.896433 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 38/76] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:46 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:46.929939 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7461d275-159f-4d49-8bcd-3c2a8744ac92 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:46.930666 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-7461d275-159f-4d49-8bcd-3c2a8744ac92 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:46.935474 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:46.940234 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7461d275-159f-4d49-8bcd-3c2a8744ac92 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:46.941005 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7461d275-159f-4d49-8bcd-3c2a8744ac92 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:46.941652 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7461d275-159f-4d49-8bcd-3c2a8744ac92 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:46.943151 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7461d275-159f-4d49-8bcd-3c2a8744ac92 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:46.943980 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7461d275-159f-4d49-8bcd-3c2a8744ac92 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:46.944610 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7461d275-159f-4d49-8bcd-3c2a8744ac92 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:47.090694 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-7461d275-159f-4d49-8bcd-3c2a8744ac92 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:47.099053 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-7461d275-159f-4d49-8bcd-3c2a8744ac92 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1367 microversion: 2.1 time: 0.175048 Sep 05 12:29:47.099943 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 39/77] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:46 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:47.219344 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c63a4e83-5e56-49d1-8121-462be87b9965 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:47.219992 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-c63a4e83-5e56-49d1-8121-462be87b9965 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:47.227763 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c63a4e83-5e56-49d1-8121-462be87b9965 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:47.228345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c63a4e83-5e56-49d1-8121-462be87b9965 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:47.228839 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c63a4e83-5e56-49d1-8121-462be87b9965 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:47.229540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c63a4e83-5e56-49d1-8121-462be87b9965 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:47.229982 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c63a4e83-5e56-49d1-8121-462be87b9965 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:47.230484 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c63a4e83-5e56-49d1-8121-462be87b9965 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:47.382402 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c63a4e83-5e56-49d1-8121-462be87b9965 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:47.391051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-c63a4e83-5e56-49d1-8121-462be87b9965 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.176477 Sep 05 12:29:47.391840 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 39/78] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:47 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:47.688118 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d6d564d6-7cd9-4832-9aec-84af1b9d7d36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:47.688721 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d6d564d6-7cd9-4832-9aec-84af1b9d7d36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:47.695254 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d6d564d6-7cd9-4832-9aec-84af1b9d7d36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:47.696036 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d6d564d6-7cd9-4832-9aec-84af1b9d7d36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:47.696537 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d6d564d6-7cd9-4832-9aec-84af1b9d7d36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:47.697404 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d6d564d6-7cd9-4832-9aec-84af1b9d7d36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:47.697933 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d6d564d6-7cd9-4832-9aec-84af1b9d7d36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:47.698429 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d6d564d6-7cd9-4832-9aec-84af1b9d7d36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:47.879731 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d6d564d6-7cd9-4832-9aec-84af1b9d7d36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:47.888162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d6d564d6-7cd9-4832-9aec-84af1b9d7d36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:47.889722 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d6d564d6-7cd9-4832-9aec-84af1b9d7d36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:47.890962 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d6d564d6-7cd9-4832-9aec-84af1b9d7d36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1406 microversion: 2.20 time: 0.206887 Sep 05 12:29:47.891511 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 40/79] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:47 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:47.918349 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-9437ccf1-437f-47bd-95c2-4e619a4f5188 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:47.922293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-9437ccf1-437f-47bd-95c2-4e619a4f5188 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:47.925103 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9437ccf1-437f-47bd-95c2-4e619a4f5188 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:47.925586 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9437ccf1-437f-47bd-95c2-4e619a4f5188 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:47.926024 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9437ccf1-437f-47bd-95c2-4e619a4f5188 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:47.927263 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9437ccf1-437f-47bd-95c2-4e619a4f5188 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:47.927760 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9437ccf1-437f-47bd-95c2-4e619a4f5188 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:47.928488 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9437ccf1-437f-47bd-95c2-4e619a4f5188 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:48.094957 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-9437ccf1-437f-47bd-95c2-4e619a4f5188 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:48.104334 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-9437ccf1-437f-47bd-95c2-4e619a4f5188 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1315 microversion: 2.1 time: 0.189777 Sep 05 12:29:48.104912 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 40/80] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:47 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:48.122780 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1c152a57-13ed-47b1-bf90-8dd54c6cb6a8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:48.123385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1c152a57-13ed-47b1-bf90-8dd54c6cb6a8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:48.129773 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1c152a57-13ed-47b1-bf90-8dd54c6cb6a8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:48.130280 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1c152a57-13ed-47b1-bf90-8dd54c6cb6a8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:48.130704 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1c152a57-13ed-47b1-bf90-8dd54c6cb6a8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:48.131406 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1c152a57-13ed-47b1-bf90-8dd54c6cb6a8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:48.131889 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1c152a57-13ed-47b1-bf90-8dd54c6cb6a8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:48.132314 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1c152a57-13ed-47b1-bf90-8dd54c6cb6a8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:48.186238 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-e598e844-1c19-4272-85cf-8e7c3364795e req-5b3757df-229b-4b8e-a216-7ba4bdf4cb07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e79b6762-27f0-4044-bed9-bd1f6d1ba687", "tag": "cd04259f-c361-432d-b45e-05d24550b093"}, {"name": "network-changed", "server_uuid": "0815c135-ccc0-412c-b960-1dba28e7b455", "tag": "b48abd9f-ccdb-4cd2-a0d6-bc38fac6b27f"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:48.202374 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-e598e844-1c19-4272-85cf-8e7c3364795e req-5b3757df-229b-4b8e-a216-7ba4bdf4cb07 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:48.202942 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-e598e844-1c19-4272-85cf-8e7c3364795e req-5b3757df-229b-4b8e-a216-7ba4bdf4cb07 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:48.204471 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-e598e844-1c19-4272-85cf-8e7c3364795e req-5b3757df-229b-4b8e-a216-7ba4bdf4cb07 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:48.221291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-e598e844-1c19-4272-85cf-8e7c3364795e req-5b3757df-229b-4b8e-a216-7ba4bdf4cb07 service nova] Creating event network-changed:cd04259f-c361-432d-b45e-05d24550b093 for instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 on hv-cinder-80135 Sep 05 12:29:48.222339 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-e598e844-1c19-4272-85cf-8e7c3364795e req-5b3757df-229b-4b8e-a216-7ba4bdf4cb07 service nova] Creating event network-changed:b48abd9f-ccdb-4cd2-a0d6-bc38fac6b27f for instance 0815c135-ccc0-412c-b960-1dba28e7b455 on hv-cinder-80135 Sep 05 12:29:48.230918 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-e598e844-1c19-4272-85cf-8e7c3364795e req-5b3757df-229b-4b8e-a216-7ba4bdf4cb07 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048784 Sep 05 12:29:48.232346 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 41/81] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:29:48.283155 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-03b1368e-52bf-4245-ac2a-691a4fd8e9fa req-ef232a93-2e17-47f6-ac8d-1a3cacccdff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0105c66-6939-4b6d-b774-c1821012c1f0", "tag": "09dffb1b-f334-42d1-bd74-8b59ed4648c3"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:29:48.297602 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-03b1368e-52bf-4245-ac2a-691a4fd8e9fa req-ef232a93-2e17-47f6-ac8d-1a3cacccdff2 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:48.298359 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-03b1368e-52bf-4245-ac2a-691a4fd8e9fa req-ef232a93-2e17-47f6-ac8d-1a3cacccdff2 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:48.298933 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-03b1368e-52bf-4245-ac2a-691a4fd8e9fa req-ef232a93-2e17-47f6-ac8d-1a3cacccdff2 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:48.329014 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1c152a57-13ed-47b1-bf90-8dd54c6cb6a8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:48.341828 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1c152a57-13ed-47b1-bf90-8dd54c6cb6a8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1367 microversion: 2.1 time: 0.222777 Sep 05 12:29:48.351635 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-03b1368e-52bf-4245-ac2a-691a4fd8e9fa req-ef232a93-2e17-47f6-ac8d-1a3cacccdff2 service nova] Creating event network-changed:09dffb1b-f334-42d1-bd74-8b59ed4648c3 for instance a0105c66-6939-4b6d-b774-c1821012c1f0 on hv-cinder-80135 Sep 05 12:29:48.353859 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 41/82] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:48 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:48.360089 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-03b1368e-52bf-4245-ac2a-691a4fd8e9fa req-ef232a93-2e17-47f6-ac8d-1a3cacccdff2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080112 Sep 05 12:29:48.361040 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 42/83] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:29:48.414644 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7d4c3cba-c28f-45af-95cd-23b07fb43d5e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:48.415337 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-7d4c3cba-c28f-45af-95cd-23b07fb43d5e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:48.428167 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7d4c3cba-c28f-45af-95cd-23b07fb43d5e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:48.428773 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7d4c3cba-c28f-45af-95cd-23b07fb43d5e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:48.431648 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7d4c3cba-c28f-45af-95cd-23b07fb43d5e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:48.431648 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7d4c3cba-c28f-45af-95cd-23b07fb43d5e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:48.431648 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7d4c3cba-c28f-45af-95cd-23b07fb43d5e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:48.431648 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7d4c3cba-c28f-45af-95cd-23b07fb43d5e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:48.622711 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-7d4c3cba-c28f-45af-95cd-23b07fb43d5e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:48.638741 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-7d4c3cba-c28f-45af-95cd-23b07fb43d5e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.227947 Sep 05 12:29:48.639328 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 42/84] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:48 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:48.921110 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-254bcf08-d7de-4e21-8c75-3fda189c5b44 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:48.922651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-254bcf08-d7de-4e21-8c75-3fda189c5b44 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:48.933535 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-254bcf08-d7de-4e21-8c75-3fda189c5b44 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:48.934532 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-254bcf08-d7de-4e21-8c75-3fda189c5b44 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:48.935157 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-254bcf08-d7de-4e21-8c75-3fda189c5b44 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:48.936064 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-254bcf08-d7de-4e21-8c75-3fda189c5b44 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:48.943370 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-254bcf08-d7de-4e21-8c75-3fda189c5b44 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:48.945062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-254bcf08-d7de-4e21-8c75-3fda189c5b44 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:48.958572 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=100 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:49.129332 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a044e0aa-9510-4065-8f9f-7a1b5ea07782 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:49.142486 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a044e0aa-9510-4065-8f9f-7a1b5ea07782 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:49.142486 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a044e0aa-9510-4065-8f9f-7a1b5ea07782 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:49.142486 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a044e0aa-9510-4065-8f9f-7a1b5ea07782 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:49.142486 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a044e0aa-9510-4065-8f9f-7a1b5ea07782 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:49.142887 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a044e0aa-9510-4065-8f9f-7a1b5ea07782 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:49.144786 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a044e0aa-9510-4065-8f9f-7a1b5ea07782 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:49.148027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a044e0aa-9510-4065-8f9f-7a1b5ea07782 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:49.234096 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-254bcf08-d7de-4e21-8c75-3fda189c5b44 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:49.243556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-254bcf08-d7de-4e21-8c75-3fda189c5b44 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:49.245205 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-254bcf08-d7de-4e21-8c75-3fda189c5b44 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:49.246534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-254bcf08-d7de-4e21-8c75-3fda189c5b44 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1406 microversion: 2.20 time: 0.330033 Sep 05 12:29:49.259647 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 43/85] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:48 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1406 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:49.368144 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8cd2b3e9-4124-4507-aacc-ec870c411575 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:49.368144 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-8cd2b3e9-4124-4507-aacc-ec870c411575 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:49.386095 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8cd2b3e9-4124-4507-aacc-ec870c411575 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:49.386095 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8cd2b3e9-4124-4507-aacc-ec870c411575 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:49.386544 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8cd2b3e9-4124-4507-aacc-ec870c411575 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:49.387250 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8cd2b3e9-4124-4507-aacc-ec870c411575 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:49.388367 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8cd2b3e9-4124-4507-aacc-ec870c411575 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:49.389562 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8cd2b3e9-4124-4507-aacc-ec870c411575 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:49.408594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a044e0aa-9510-4065-8f9f-7a1b5ea07782 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:49.419817 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a044e0aa-9510-4065-8f9f-7a1b5ea07782 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1315 microversion: 2.1 time: 0.296640 Sep 05 12:29:49.435121 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 43/86] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:49 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:49.627821 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-8cd2b3e9-4124-4507-aacc-ec870c411575 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:49.643687 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-8cd2b3e9-4124-4507-aacc-ec870c411575 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1367 microversion: 2.1 time: 0.281202 Sep 05 12:29:49.644316 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 44/87] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:49 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:29:49.663198 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-73c6a620-8160-4ff2-a68a-f12a6af7b7b1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:49.664070 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-73c6a620-8160-4ff2-a68a-f12a6af7b7b1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:49.674959 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-73c6a620-8160-4ff2-a68a-f12a6af7b7b1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:49.675460 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-73c6a620-8160-4ff2-a68a-f12a6af7b7b1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:49.675923 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-73c6a620-8160-4ff2-a68a-f12a6af7b7b1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:49.676837 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-73c6a620-8160-4ff2-a68a-f12a6af7b7b1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:49.677436 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-73c6a620-8160-4ff2-a68a-f12a6af7b7b1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:49.678007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-73c6a620-8160-4ff2-a68a-f12a6af7b7b1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:49.857514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-73c6a620-8160-4ff2-a68a-f12a6af7b7b1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:49.871054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-73c6a620-8160-4ff2-a68a-f12a6af7b7b1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.212315 Sep 05 12:29:49.872095 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 44/88] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:49 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:50.275397 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c3112c43-d615-4aa4-ab78-50061fe8aaf7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:50.275397 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-c3112c43-d615-4aa4-ab78-50061fe8aaf7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:50.293077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c3112c43-d615-4aa4-ab78-50061fe8aaf7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:50.293580 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c3112c43-d615-4aa4-ab78-50061fe8aaf7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:50.294028 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c3112c43-d615-4aa4-ab78-50061fe8aaf7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:50.294924 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c3112c43-d615-4aa4-ab78-50061fe8aaf7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:50.295637 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c3112c43-d615-4aa4-ab78-50061fe8aaf7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:50.296252 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c3112c43-d615-4aa4-ab78-50061fe8aaf7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:50.450998 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-8c806f30-8ea4-4377-8637-362dee04f674 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:50.455021 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-8c806f30-8ea4-4377-8637-362dee04f674 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:50.463315 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c3112c43-d615-4aa4-ab78-50061fe8aaf7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:50.476192 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c806f30-8ea4-4377-8637-362dee04f674 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:50.477186 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c3112c43-d615-4aa4-ab78-50061fe8aaf7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:50.477674 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c806f30-8ea4-4377-8637-362dee04f674 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:50.479214 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c806f30-8ea4-4377-8637-362dee04f674 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:50.479691 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c3112c43-d615-4aa4-ab78-50061fe8aaf7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:50.480116 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c806f30-8ea4-4377-8637-362dee04f674 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:50.481777 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-c3112c43-d615-4aa4-ab78-50061fe8aaf7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1406 microversion: 2.20 time: 0.212134 Sep 05 12:29:50.482966 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 45/89] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:50 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:50.484376 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c806f30-8ea4-4377-8637-362dee04f674 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:50.486289 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c806f30-8ea4-4377-8637-362dee04f674 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:50.646781 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-8c806f30-8ea4-4377-8637-362dee04f674 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:50.655892 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-8c806f30-8ea4-4377-8637-362dee04f674 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1315 microversion: 2.1 time: 0.210323 Sep 05 12:29:50.656476 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 45/90] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:50 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:50.672703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-cf60b679-4303-4100-919b-64dbe1793ed6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:50.673336 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-cf60b679-4303-4100-919b-64dbe1793ed6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:50.684344 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cf60b679-4303-4100-919b-64dbe1793ed6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:50.684616 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cf60b679-4303-4100-919b-64dbe1793ed6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:50.685051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cf60b679-4303-4100-919b-64dbe1793ed6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:50.689119 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cf60b679-4303-4100-919b-64dbe1793ed6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:50.689531 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cf60b679-4303-4100-919b-64dbe1793ed6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:50.691592 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cf60b679-4303-4100-919b-64dbe1793ed6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:50.896920 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-5b02139d-7ada-40f9-be04-370241e62f12 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:50.897526 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-5b02139d-7ada-40f9-be04-370241e62f12 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:50.922309 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5b02139d-7ada-40f9-be04-370241e62f12 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:50.925082 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5b02139d-7ada-40f9-be04-370241e62f12 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:50.925082 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5b02139d-7ada-40f9-be04-370241e62f12 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:50.925890 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5b02139d-7ada-40f9-be04-370241e62f12 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:50.926382 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5b02139d-7ada-40f9-be04-370241e62f12 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:50.926808 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5b02139d-7ada-40f9-be04-370241e62f12 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:51.062936 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-cf60b679-4303-4100-919b-64dbe1793ed6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:51.083083 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-cf60b679-4303-4100-919b-64dbe1793ed6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1367 microversion: 2.1 time: 0.411531 Sep 05 12:29:51.084988 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 46/91] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:50 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1367 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:51.508545 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-9f60353e-aa44-48e9-9d6e-70d69f0ab2c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:51.512789 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-9f60353e-aa44-48e9-9d6e-70d69f0ab2c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:51.526637 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9f60353e-aa44-48e9-9d6e-70d69f0ab2c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:51.527633 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9f60353e-aa44-48e9-9d6e-70d69f0ab2c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:51.528852 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9f60353e-aa44-48e9-9d6e-70d69f0ab2c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:51.531117 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9f60353e-aa44-48e9-9d6e-70d69f0ab2c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:51.532882 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9f60353e-aa44-48e9-9d6e-70d69f0ab2c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:51.533940 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9f60353e-aa44-48e9-9d6e-70d69f0ab2c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:51.843519 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-5b02139d-7ada-40f9-be04-370241e62f12 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:51.859877 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-5b02139d-7ada-40f9-be04-370241e62f12 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.968306 Sep 05 12:29:51.875223 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 46/92] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:50 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:51.882152 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7626e827-3a3a-46e3-9a00-46eb1b53a326 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:51.882784 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-7626e827-3a3a-46e3-9a00-46eb1b53a326 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:51.907186 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7626e827-3a3a-46e3-9a00-46eb1b53a326 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:51.907842 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7626e827-3a3a-46e3-9a00-46eb1b53a326 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:51.908286 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7626e827-3a3a-46e3-9a00-46eb1b53a326 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:51.909104 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7626e827-3a3a-46e3-9a00-46eb1b53a326 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:51.909663 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7626e827-3a3a-46e3-9a00-46eb1b53a326 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:51.910142 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7626e827-3a3a-46e3-9a00-46eb1b53a326 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:51.994816 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-9f60353e-aa44-48e9-9d6e-70d69f0ab2c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:52.014579 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-9f60353e-aa44-48e9-9d6e-70d69f0ab2c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:52.017706 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-9f60353e-aa44-48e9-9d6e-70d69f0ab2c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:52.019617 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-9f60353e-aa44-48e9-9d6e-70d69f0ab2c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1406 microversion: 2.20 time: 0.515664 Sep 05 12:29:52.037296 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 47/93] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:51 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1406 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:52.108488 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-bcb1723c-537b-42e9-9359-0a584d339166 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:52.109766 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-bcb1723c-537b-42e9-9359-0a584d339166 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:52.118410 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bcb1723c-537b-42e9-9359-0a584d339166 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:52.118892 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bcb1723c-537b-42e9-9359-0a584d339166 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:52.119327 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bcb1723c-537b-42e9-9359-0a584d339166 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:52.120051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bcb1723c-537b-42e9-9359-0a584d339166 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:52.120609 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bcb1723c-537b-42e9-9359-0a584d339166 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:52.121038 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bcb1723c-537b-42e9-9359-0a584d339166 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:52.474985 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-7626e827-3a3a-46e3-9a00-46eb1b53a326 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:52.512774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-7626e827-3a3a-46e3-9a00-46eb1b53a326 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1315 microversion: 2.1 time: 0.634054 Sep 05 12:29:52.534221 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 47/94] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:51 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1315 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:52.708885 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-bcb1723c-537b-42e9-9359-0a584d339166 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:52.719653 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-bcb1723c-537b-42e9-9359-0a584d339166 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1367 microversion: 2.1 time: 0.615282 Sep 05 12:29:52.721042 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 48/95] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:52 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1367 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:29:52.888341 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-172bd45c-abac-4105-9242-e22b0c35bc54 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:52.889232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-172bd45c-abac-4105-9242-e22b0c35bc54 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:52.902744 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-172bd45c-abac-4105-9242-e22b0c35bc54 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:52.903676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-172bd45c-abac-4105-9242-e22b0c35bc54 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:52.904642 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-172bd45c-abac-4105-9242-e22b0c35bc54 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:52.905927 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-172bd45c-abac-4105-9242-e22b0c35bc54 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:52.908110 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-172bd45c-abac-4105-9242-e22b0c35bc54 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:52.909254 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-172bd45c-abac-4105-9242-e22b0c35bc54 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:53.050681 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-2382df60-ac0b-4b43-9656-cad6e1ededd0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:53.052294 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-2382df60-ac0b-4b43-9656-cad6e1ededd0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:53.061473 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2382df60-ac0b-4b43-9656-cad6e1ededd0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:53.072310 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2382df60-ac0b-4b43-9656-cad6e1ededd0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:53.072753 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2382df60-ac0b-4b43-9656-cad6e1ededd0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:53.073494 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2382df60-ac0b-4b43-9656-cad6e1ededd0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:53.073945 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2382df60-ac0b-4b43-9656-cad6e1ededd0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:53.074362 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2382df60-ac0b-4b43-9656-cad6e1ededd0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:53.131500 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-172bd45c-abac-4105-9242-e22b0c35bc54 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:53.139435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-172bd45c-abac-4105-9242-e22b0c35bc54 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.256785 Sep 05 12:29:53.151561 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 48/96] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:52 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:53.332285 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-2382df60-ac0b-4b43-9656-cad6e1ededd0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:53.341133 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-2382df60-ac0b-4b43-9656-cad6e1ededd0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:53.342663 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-2382df60-ac0b-4b43-9656-cad6e1ededd0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:53.343806 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-2382df60-ac0b-4b43-9656-cad6e1ededd0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1406 microversion: 2.20 time: 0.297153 Sep 05 12:29:53.344358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 49/97] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:53 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1406 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:53.543294 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-becb17a2-cf16-4834-8c90-71907b3a9fb0 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:53.544056 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-becb17a2-cf16-4834-8c90-71907b3a9fb0 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:53.550709 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-becb17a2-cf16-4834-8c90-71907b3a9fb0 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:53.551311 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-becb17a2-cf16-4834-8c90-71907b3a9fb0 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:53.551900 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-becb17a2-cf16-4834-8c90-71907b3a9fb0 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:53.552672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-becb17a2-cf16-4834-8c90-71907b3a9fb0 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:53.553174 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-becb17a2-cf16-4834-8c90-71907b3a9fb0 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:53.553670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-becb17a2-cf16-4834-8c90-71907b3a9fb0 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:53.699122 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-becb17a2-cf16-4834-8c90-71907b3a9fb0 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:53.706876 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-becb17a2-cf16-4834-8c90-71907b3a9fb0 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1315 microversion: 2.1 time: 0.167910 Sep 05 12:29:53.707438 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 49/98] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:53 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:53.746044 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-555d9241-6a45-4181-9a02-489a0307be38 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:53.746961 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-555d9241-6a45-4181-9a02-489a0307be38 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:53.753847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-555d9241-6a45-4181-9a02-489a0307be38 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:53.755101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-555d9241-6a45-4181-9a02-489a0307be38 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:53.755735 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-555d9241-6a45-4181-9a02-489a0307be38 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:53.756442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-555d9241-6a45-4181-9a02-489a0307be38 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:53.756898 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-555d9241-6a45-4181-9a02-489a0307be38 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:53.757319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-555d9241-6a45-4181-9a02-489a0307be38 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:54.021880 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-555d9241-6a45-4181-9a02-489a0307be38 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:54.034166 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-555d9241-6a45-4181-9a02-489a0307be38 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1367 microversion: 2.1 time: 0.291517 Sep 05 12:29:54.057143 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 50/99] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:53 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:54.162743 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-b37b88c6-8fca-4e8c-8237-82c1a04281f3 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:54.163358 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-b37b88c6-8fca-4e8c-8237-82c1a04281f3 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:54.169482 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b37b88c6-8fca-4e8c-8237-82c1a04281f3 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:54.169971 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b37b88c6-8fca-4e8c-8237-82c1a04281f3 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:54.170402 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b37b88c6-8fca-4e8c-8237-82c1a04281f3 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:54.171098 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b37b88c6-8fca-4e8c-8237-82c1a04281f3 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:54.171629 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b37b88c6-8fca-4e8c-8237-82c1a04281f3 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:54.172152 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b37b88c6-8fca-4e8c-8237-82c1a04281f3 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:54.314925 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-b37b88c6-8fca-4e8c-8237-82c1a04281f3 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:54.323838 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-b37b88c6-8fca-4e8c-8237-82c1a04281f3 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.164860 Sep 05 12:29:54.324323 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 50/100] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:54 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:54.369848 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-db7070d8-f947-40ab-9448-1d3fe8793189 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:54.370458 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-db7070d8-f947-40ab-9448-1d3fe8793189 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:54.376339 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-db7070d8-f947-40ab-9448-1d3fe8793189 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:54.376817 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-db7070d8-f947-40ab-9448-1d3fe8793189 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:54.377249 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-db7070d8-f947-40ab-9448-1d3fe8793189 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:54.377936 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-db7070d8-f947-40ab-9448-1d3fe8793189 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:54.378391 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-db7070d8-f947-40ab-9448-1d3fe8793189 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:54.378820 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-db7070d8-f947-40ab-9448-1d3fe8793189 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:54.511571 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-db7070d8-f947-40ab-9448-1d3fe8793189 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:54.525066 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-db7070d8-f947-40ab-9448-1d3fe8793189 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:54.530670 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-db7070d8-f947-40ab-9448-1d3fe8793189 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:54.530670 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-db7070d8-f947-40ab-9448-1d3fe8793189 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1406 microversion: 2.20 time: 0.162160 Sep 05 12:29:54.530670 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 51/101] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:54 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:54.732226 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-aa70460b-b19d-4245-ab1a-ebd32ad376c4 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:54.733105 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-aa70460b-b19d-4245-ab1a-ebd32ad376c4 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:54.739251 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aa70460b-b19d-4245-ab1a-ebd32ad376c4 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:54.739771 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aa70460b-b19d-4245-ab1a-ebd32ad376c4 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:54.740341 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aa70460b-b19d-4245-ab1a-ebd32ad376c4 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:54.740885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aa70460b-b19d-4245-ab1a-ebd32ad376c4 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:54.741325 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aa70460b-b19d-4245-ab1a-ebd32ad376c4 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:54.741738 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aa70460b-b19d-4245-ab1a-ebd32ad376c4 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:54.903832 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-aa70460b-b19d-4245-ab1a-ebd32ad376c4 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:54.909206 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-aa70460b-b19d-4245-ab1a-ebd32ad376c4 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1315 microversion: 2.1 time: 0.181023 Sep 05 12:29:54.909776 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 51/102] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:54 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:55.058208 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3d886989-5a67-4edc-8e98-88e6b1852621 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:55.058918 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-3d886989-5a67-4edc-8e98-88e6b1852621 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:55.064898 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3d886989-5a67-4edc-8e98-88e6b1852621 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:55.065383 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3d886989-5a67-4edc-8e98-88e6b1852621 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:55.065819 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3d886989-5a67-4edc-8e98-88e6b1852621 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:55.068423 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3d886989-5a67-4edc-8e98-88e6b1852621 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:55.068423 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3d886989-5a67-4edc-8e98-88e6b1852621 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:55.068423 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3d886989-5a67-4edc-8e98-88e6b1852621 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:55.214088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3d886989-5a67-4edc-8e98-88e6b1852621 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:55.221809 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3d886989-5a67-4edc-8e98-88e6b1852621 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1367 microversion: 2.1 time: 0.167350 Sep 05 12:29:55.222390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 52/103] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:55 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:55.347386 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a53f129c-0a19-4166-a5fb-cae0d974a3a4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:55.348435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a53f129c-0a19-4166-a5fb-cae0d974a3a4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:55.355212 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a53f129c-0a19-4166-a5fb-cae0d974a3a4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:55.356303 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a53f129c-0a19-4166-a5fb-cae0d974a3a4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:55.358889 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a53f129c-0a19-4166-a5fb-cae0d974a3a4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:55.360246 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a53f129c-0a19-4166-a5fb-cae0d974a3a4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:55.360819 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a53f129c-0a19-4166-a5fb-cae0d974a3a4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:55.361431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a53f129c-0a19-4166-a5fb-cae0d974a3a4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:55.366936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=100 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:55.560465 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4079d74c-6d73-4386-b920-8f3a25e23afc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:55.563031 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4079d74c-6d73-4386-b920-8f3a25e23afc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:55.580693 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4079d74c-6d73-4386-b920-8f3a25e23afc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:55.581712 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4079d74c-6d73-4386-b920-8f3a25e23afc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:55.583187 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4079d74c-6d73-4386-b920-8f3a25e23afc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:55.584265 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4079d74c-6d73-4386-b920-8f3a25e23afc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:55.585506 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4079d74c-6d73-4386-b920-8f3a25e23afc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:55.586161 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4079d74c-6d73-4386-b920-8f3a25e23afc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:55.733052 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a53f129c-0a19-4166-a5fb-cae0d974a3a4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:55.742049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a53f129c-0a19-4166-a5fb-cae0d974a3a4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.399340 Sep 05 12:29:55.761421 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 52/104] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:55 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:55.935328 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-080158a0-8957-4a6a-9806-a2a0a95c5b63 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:55.936167 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-080158a0-8957-4a6a-9806-a2a0a95c5b63 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:55.942250 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-080158a0-8957-4a6a-9806-a2a0a95c5b63 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:55.942732 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-080158a0-8957-4a6a-9806-a2a0a95c5b63 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:55.943157 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-080158a0-8957-4a6a-9806-a2a0a95c5b63 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:55.943883 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-080158a0-8957-4a6a-9806-a2a0a95c5b63 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:55.944327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-080158a0-8957-4a6a-9806-a2a0a95c5b63 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:55.944747 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-080158a0-8957-4a6a-9806-a2a0a95c5b63 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:55.953737 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-4079d74c-6d73-4386-b920-8f3a25e23afc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:55.968237 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-4079d74c-6d73-4386-b920-8f3a25e23afc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:55.972316 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-4079d74c-6d73-4386-b920-8f3a25e23afc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:55.972316 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4079d74c-6d73-4386-b920-8f3a25e23afc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1406 microversion: 2.20 time: 0.418963 Sep 05 12:29:55.975618 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 53/105] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:55 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1406 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:56.087109 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-080158a0-8957-4a6a-9806-a2a0a95c5b63 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:56.094836 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-080158a0-8957-4a6a-9806-a2a0a95c5b63 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1315 microversion: 2.1 time: 0.165188 Sep 05 12:29:56.095423 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 53/106] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:55 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:56.248957 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4a7136b5-54e0-4c51-bdd8-2e10a14a0a3a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:56.249517 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4a7136b5-54e0-4c51-bdd8-2e10a14a0a3a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:56.251455 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=2 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:56.263077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a7136b5-54e0-4c51-bdd8-2e10a14a0a3a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:56.266693 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a7136b5-54e0-4c51-bdd8-2e10a14a0a3a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:56.267453 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a7136b5-54e0-4c51-bdd8-2e10a14a0a3a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:56.268609 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a7136b5-54e0-4c51-bdd8-2e10a14a0a3a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:56.269234 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a7136b5-54e0-4c51-bdd8-2e10a14a0a3a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:56.269990 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a7136b5-54e0-4c51-bdd8-2e10a14a0a3a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:56.460141 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-4a7136b5-54e0-4c51-bdd8-2e10a14a0a3a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:56.468154 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4a7136b5-54e0-4c51-bdd8-2e10a14a0a3a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1367 microversion: 2.1 time: 0.223400 Sep 05 12:29:56.468724 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 54/107] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:56 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:56.771153 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-61d1f4a1-0e26-4d9e-86b5-155693c30767 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:56.771806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-61d1f4a1-0e26-4d9e-86b5-155693c30767 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:56.777590 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-61d1f4a1-0e26-4d9e-86b5-155693c30767 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:56.778066 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-61d1f4a1-0e26-4d9e-86b5-155693c30767 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:56.778485 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-61d1f4a1-0e26-4d9e-86b5-155693c30767 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:56.779160 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-61d1f4a1-0e26-4d9e-86b5-155693c30767 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:56.779640 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-61d1f4a1-0e26-4d9e-86b5-155693c30767 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:56.780095 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-61d1f4a1-0e26-4d9e-86b5-155693c30767 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:56.919286 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-61d1f4a1-0e26-4d9e-86b5-155693c30767 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:56.927046 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-61d1f4a1-0e26-4d9e-86b5-155693c30767 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.160653 Sep 05 12:29:56.927625 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 54/108] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:56 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:57.000200 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-2b9da0db-2829-47c9-b5d8-03f4232b0861 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:57.000803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-2b9da0db-2829-47c9-b5d8-03f4232b0861 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:57.007752 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2b9da0db-2829-47c9-b5d8-03f4232b0861 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:57.008229 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2b9da0db-2829-47c9-b5d8-03f4232b0861 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:57.008656 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2b9da0db-2829-47c9-b5d8-03f4232b0861 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:57.009333 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2b9da0db-2829-47c9-b5d8-03f4232b0861 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:57.009781 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2b9da0db-2829-47c9-b5d8-03f4232b0861 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:57.010197 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2b9da0db-2829-47c9-b5d8-03f4232b0861 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:57.119482 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-9795517d-1d51-4e33-b77f-5fb42acfd9c0 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:57.120619 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-9795517d-1d51-4e33-b77f-5fb42acfd9c0 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:57.126811 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9795517d-1d51-4e33-b77f-5fb42acfd9c0 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:57.127585 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9795517d-1d51-4e33-b77f-5fb42acfd9c0 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:57.128258 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9795517d-1d51-4e33-b77f-5fb42acfd9c0 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:57.129101 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9795517d-1d51-4e33-b77f-5fb42acfd9c0 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:57.130344 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9795517d-1d51-4e33-b77f-5fb42acfd9c0 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:57.130873 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9795517d-1d51-4e33-b77f-5fb42acfd9c0 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:57.154366 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-2b9da0db-2829-47c9-b5d8-03f4232b0861 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:57.168632 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-2b9da0db-2829-47c9-b5d8-03f4232b0861 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:57.171583 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-2b9da0db-2829-47c9-b5d8-03f4232b0861 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:57.173363 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-2b9da0db-2829-47c9-b5d8-03f4232b0861 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1406 microversion: 2.20 time: 0.176698 Sep 05 12:29:57.174343 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 55/109] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:56 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:57.288561 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-9795517d-1d51-4e33-b77f-5fb42acfd9c0 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:57.301173 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-9795517d-1d51-4e33-b77f-5fb42acfd9c0 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1315 microversion: 2.1 time: 0.185319 Sep 05 12:29:57.303121 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 55/110] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:57 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:29:57.493373 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-120ce6ae-039c-49d9-9725-4f0b5a8d686f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:57.494007 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-120ce6ae-039c-49d9-9725-4f0b5a8d686f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:57.501718 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-120ce6ae-039c-49d9-9725-4f0b5a8d686f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:57.502205 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-120ce6ae-039c-49d9-9725-4f0b5a8d686f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:57.502641 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-120ce6ae-039c-49d9-9725-4f0b5a8d686f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:57.503378 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-120ce6ae-039c-49d9-9725-4f0b5a8d686f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:57.505366 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-120ce6ae-039c-49d9-9725-4f0b5a8d686f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:57.506031 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-120ce6ae-039c-49d9-9725-4f0b5a8d686f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:57.646109 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-120ce6ae-039c-49d9-9725-4f0b5a8d686f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:57.657926 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-120ce6ae-039c-49d9-9725-4f0b5a8d686f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1367 microversion: 2.1 time: 0.166778 Sep 05 12:29:57.657926 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 56/111] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:57 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:57.952673 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-c2782ffb-8635-4938-9740-cf7ecced4aed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:57.953460 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-c2782ffb-8635-4938-9740-cf7ecced4aed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:57.960196 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c2782ffb-8635-4938-9740-cf7ecced4aed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:57.960678 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c2782ffb-8635-4938-9740-cf7ecced4aed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:57.961112 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c2782ffb-8635-4938-9740-cf7ecced4aed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:57.962098 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c2782ffb-8635-4938-9740-cf7ecced4aed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:57.962722 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c2782ffb-8635-4938-9740-cf7ecced4aed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:57.963142 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c2782ffb-8635-4938-9740-cf7ecced4aed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:58.099905 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c2782ffb-8635-4938-9740-cf7ecced4aed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:58.107681 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-c2782ffb-8635-4938-9740-cf7ecced4aed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.158884 Sep 05 12:29:58.108219 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 56/112] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:57 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:58.202257 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7dba3a06-6d57-4dd9-8883-47f156cabdcf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:58.203001 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-7dba3a06-6d57-4dd9-8883-47f156cabdcf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:58.210518 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7dba3a06-6d57-4dd9-8883-47f156cabdcf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:58.240965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7dba3a06-6d57-4dd9-8883-47f156cabdcf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:58.240965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7dba3a06-6d57-4dd9-8883-47f156cabdcf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:58.240965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7dba3a06-6d57-4dd9-8883-47f156cabdcf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:58.240965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7dba3a06-6d57-4dd9-8883-47f156cabdcf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:58.242072 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7dba3a06-6d57-4dd9-8883-47f156cabdcf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:58.327640 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-b1d4a09c-ac0e-4bef-9aee-f1fa3357374f tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:58.328744 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-b1d4a09c-ac0e-4bef-9aee-f1fa3357374f tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:58.338689 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b1d4a09c-ac0e-4bef-9aee-f1fa3357374f tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:58.338689 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b1d4a09c-ac0e-4bef-9aee-f1fa3357374f tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:58.338689 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b1d4a09c-ac0e-4bef-9aee-f1fa3357374f tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:58.338689 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b1d4a09c-ac0e-4bef-9aee-f1fa3357374f tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:58.339022 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b1d4a09c-ac0e-4bef-9aee-f1fa3357374f tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:58.339022 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b1d4a09c-ac0e-4bef-9aee-f1fa3357374f tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:58.367057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-7dba3a06-6d57-4dd9-8883-47f156cabdcf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:58.376374 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-7dba3a06-6d57-4dd9-8883-47f156cabdcf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:58.378126 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-7dba3a06-6d57-4dd9-8883-47f156cabdcf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:58.383500 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-7dba3a06-6d57-4dd9-8883-47f156cabdcf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1406 microversion: 2.20 time: 0.185035 Sep 05 12:29:58.384500 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 57/113] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:58 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:29:58.535957 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-b1d4a09c-ac0e-4bef-9aee-f1fa3357374f tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:58.544445 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-b1d4a09c-ac0e-4bef-9aee-f1fa3357374f tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1315 microversion: 2.1 time: 0.222015 Sep 05 12:29:58.545256 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 57/114] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:58 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:29:58.682577 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-315001ba-d204-45e6-b0c0-1c3a36d4a3f7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:58.684089 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-315001ba-d204-45e6-b0c0-1c3a36d4a3f7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:58.692970 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-315001ba-d204-45e6-b0c0-1c3a36d4a3f7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:58.694152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-315001ba-d204-45e6-b0c0-1c3a36d4a3f7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:58.695259 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-315001ba-d204-45e6-b0c0-1c3a36d4a3f7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:58.696552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-315001ba-d204-45e6-b0c0-1c3a36d4a3f7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:58.697975 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-315001ba-d204-45e6-b0c0-1c3a36d4a3f7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:58.698560 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-315001ba-d204-45e6-b0c0-1c3a36d4a3f7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:59.075587 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-315001ba-d204-45e6-b0c0-1c3a36d4a3f7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:59.084002 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-315001ba-d204-45e6-b0c0-1c3a36d4a3f7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1367 microversion: 2.1 time: 0.405877 Sep 05 12:29:59.084581 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 58/115] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:58 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1367 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:29:59.130501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-2009b5a2-06a9-4513-8927-f7a32e247be7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:59.131172 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-2009b5a2-06a9-4513-8927-f7a32e247be7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:59.137238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2009b5a2-06a9-4513-8927-f7a32e247be7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:59.137726 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2009b5a2-06a9-4513-8927-f7a32e247be7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:59.138362 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2009b5a2-06a9-4513-8927-f7a32e247be7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:59.139253 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2009b5a2-06a9-4513-8927-f7a32e247be7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:59.139718 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2009b5a2-06a9-4513-8927-f7a32e247be7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:59.140309 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2009b5a2-06a9-4513-8927-f7a32e247be7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:59.291096 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-2009b5a2-06a9-4513-8927-f7a32e247be7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:59.299640 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-2009b5a2-06a9-4513-8927-f7a32e247be7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.173021 Sep 05 12:29:59.300229 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 58/116] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:59 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:29:59.426669 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-bd00d47e-4fcc-4480-9b10-d844d7fee090 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:59.428432 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-bd00d47e-4fcc-4480-9b10-d844d7fee090 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:59.445665 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bd00d47e-4fcc-4480-9b10-d844d7fee090 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:59.445665 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bd00d47e-4fcc-4480-9b10-d844d7fee090 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:59.445665 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bd00d47e-4fcc-4480-9b10-d844d7fee090 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:59.445665 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bd00d47e-4fcc-4480-9b10-d844d7fee090 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:59.446203 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bd00d47e-4fcc-4480-9b10-d844d7fee090 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:59.446203 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bd00d47e-4fcc-4480-9b10-d844d7fee090 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:59.570702 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-9339b276-5dce-4357-b003-d3d67599bfbb tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:29:59.583428 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-9339b276-5dce-4357-b003-d3d67599bfbb tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:29:59.583428 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9339b276-5dce-4357-b003-d3d67599bfbb tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:59.583428 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9339b276-5dce-4357-b003-d3d67599bfbb tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:59.583428 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9339b276-5dce-4357-b003-d3d67599bfbb tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:59.584299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9339b276-5dce-4357-b003-d3d67599bfbb tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:29:59.584299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9339b276-5dce-4357-b003-d3d67599bfbb tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:29:59.584886 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9339b276-5dce-4357-b003-d3d67599bfbb tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:29:59.627436 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-bd00d47e-4fcc-4480-9b10-d844d7fee090 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:59.632074 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=100 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:59.637895 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-bd00d47e-4fcc-4480-9b10-d844d7fee090 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:59.639567 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-bd00d47e-4fcc-4480-9b10-d844d7fee090 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:59.640681 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-bd00d47e-4fcc-4480-9b10-d844d7fee090 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1406 microversion: 2.20 time: 0.221375 Sep 05 12:29:59.641234 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 59/117] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:29:59 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:29:59.764864 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-9339b276-5dce-4357-b003-d3d67599bfbb tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:29:59.778762 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-9339b276-5dce-4357-b003-d3d67599bfbb tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1315 microversion: 2.1 time: 0.213356 Sep 05 12:29:59.780039 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 59/118] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:29:59 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:30:00.113651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0451e07b-368e-4186-b0d9-4a067614116e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:00.113651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0451e07b-368e-4186-b0d9-4a067614116e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:00.121572 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0451e07b-368e-4186-b0d9-4a067614116e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:00.122349 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0451e07b-368e-4186-b0d9-4a067614116e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:00.123144 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0451e07b-368e-4186-b0d9-4a067614116e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:00.124235 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0451e07b-368e-4186-b0d9-4a067614116e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:00.124961 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0451e07b-368e-4186-b0d9-4a067614116e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:00.125816 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0451e07b-368e-4186-b0d9-4a067614116e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:00.279937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0451e07b-368e-4186-b0d9-4a067614116e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:00.291276 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0451e07b-368e-4186-b0d9-4a067614116e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1367 microversion: 2.1 time: 0.186388 Sep 05 12:30:00.292481 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 60/119] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:00 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:00.323187 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-94caa24a-6dd1-409e-8be7-a8c27095cadd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:00.323911 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-94caa24a-6dd1-409e-8be7-a8c27095cadd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:00.330042 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-94caa24a-6dd1-409e-8be7-a8c27095cadd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:00.330561 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-94caa24a-6dd1-409e-8be7-a8c27095cadd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:00.331639 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-94caa24a-6dd1-409e-8be7-a8c27095cadd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:00.331905 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-94caa24a-6dd1-409e-8be7-a8c27095cadd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:00.332358 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-94caa24a-6dd1-409e-8be7-a8c27095cadd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:00.332990 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-94caa24a-6dd1-409e-8be7-a8c27095cadd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:00.475991 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-94caa24a-6dd1-409e-8be7-a8c27095cadd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:00.483641 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-94caa24a-6dd1-409e-8be7-a8c27095cadd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.164879 Sep 05 12:30:00.484208 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 60/120] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:00 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:00.668889 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-43268388-ceae-4c07-a529-076f9dfa146e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:00.669539 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-43268388-ceae-4c07-a529-076f9dfa146e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:00.676224 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-43268388-ceae-4c07-a529-076f9dfa146e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:00.678039 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-43268388-ceae-4c07-a529-076f9dfa146e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:00.678487 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-43268388-ceae-4c07-a529-076f9dfa146e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:00.679469 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-43268388-ceae-4c07-a529-076f9dfa146e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:00.680315 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-43268388-ceae-4c07-a529-076f9dfa146e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:00.680931 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-43268388-ceae-4c07-a529-076f9dfa146e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:00.809671 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-20cedd30-1cec-48d9-b0ce-4bacfdacf839 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:00.819950 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-20cedd30-1cec-48d9-b0ce-4bacfdacf839 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:00.848902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-20cedd30-1cec-48d9-b0ce-4bacfdacf839 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:00.850147 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-20cedd30-1cec-48d9-b0ce-4bacfdacf839 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:00.856070 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-20cedd30-1cec-48d9-b0ce-4bacfdacf839 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:00.856070 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-20cedd30-1cec-48d9-b0ce-4bacfdacf839 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:00.856070 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-20cedd30-1cec-48d9-b0ce-4bacfdacf839 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:00.856070 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-20cedd30-1cec-48d9-b0ce-4bacfdacf839 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:00.880553 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-43268388-ceae-4c07-a529-076f9dfa146e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:00.897458 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-43268388-ceae-4c07-a529-076f9dfa146e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:00.900083 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-43268388-ceae-4c07-a529-076f9dfa146e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:00.902094 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-43268388-ceae-4c07-a529-076f9dfa146e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1406 microversion: 2.20 time: 0.237214 Sep 05 12:30:00.903696 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 61/121] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:30:00 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:30:01.161992 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-20cedd30-1cec-48d9-b0ce-4bacfdacf839 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:01.161992 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-20cedd30-1cec-48d9-b0ce-4bacfdacf839 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1315 microversion: 2.1 time: 0.274347 Sep 05 12:30:01.161992 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 61/122] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:00 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:30:01.316095 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ffe17778-b651-4711-9b63-90ca8960ac04 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:01.316885 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ffe17778-b651-4711-9b63-90ca8960ac04 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:01.324245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ffe17778-b651-4711-9b63-90ca8960ac04 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:01.324730 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ffe17778-b651-4711-9b63-90ca8960ac04 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:01.325160 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ffe17778-b651-4711-9b63-90ca8960ac04 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:01.325968 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ffe17778-b651-4711-9b63-90ca8960ac04 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:01.326421 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ffe17778-b651-4711-9b63-90ca8960ac04 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:01.326838 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ffe17778-b651-4711-9b63-90ca8960ac04 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:01.473782 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ffe17778-b651-4711-9b63-90ca8960ac04 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:01.496696 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ffe17778-b651-4711-9b63-90ca8960ac04 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1367 microversion: 2.1 time: 0.184608 Sep 05 12:30:01.497275 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 62/123] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:01 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:01.507129 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-91c320f0-6164-4168-8170-f7cab7b4e58c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:01.507884 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-91c320f0-6164-4168-8170-f7cab7b4e58c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:01.514145 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-91c320f0-6164-4168-8170-f7cab7b4e58c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:01.514703 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-91c320f0-6164-4168-8170-f7cab7b4e58c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:01.515198 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-91c320f0-6164-4168-8170-f7cab7b4e58c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:01.516217 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-91c320f0-6164-4168-8170-f7cab7b4e58c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:01.516738 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-91c320f0-6164-4168-8170-f7cab7b4e58c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:01.517161 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-91c320f0-6164-4168-8170-f7cab7b4e58c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:01.684135 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-91c320f0-6164-4168-8170-f7cab7b4e58c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:01.692841 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-91c320f0-6164-4168-8170-f7cab7b4e58c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.189392 Sep 05 12:30:01.693673 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 62/124] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:01 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:01.928993 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-b392b03c-afc6-4e8b-adb5-b7d17164999f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:01.929600 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-b392b03c-afc6-4e8b-adb5-b7d17164999f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:01.936580 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b392b03c-afc6-4e8b-adb5-b7d17164999f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:01.937350 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b392b03c-afc6-4e8b-adb5-b7d17164999f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:01.937775 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b392b03c-afc6-4e8b-adb5-b7d17164999f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:01.938642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b392b03c-afc6-4e8b-adb5-b7d17164999f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:01.939099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b392b03c-afc6-4e8b-adb5-b7d17164999f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:01.939508 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b392b03c-afc6-4e8b-adb5-b7d17164999f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:02.109477 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-cdb564f3-3d2c-4698-ae5a-b42a4fdcba7c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:02.110496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-cdb564f3-3d2c-4698-ae5a-b42a4fdcba7c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:02.122217 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cdb564f3-3d2c-4698-ae5a-b42a4fdcba7c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:02.123098 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cdb564f3-3d2c-4698-ae5a-b42a4fdcba7c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:02.123912 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cdb564f3-3d2c-4698-ae5a-b42a4fdcba7c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:02.125443 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cdb564f3-3d2c-4698-ae5a-b42a4fdcba7c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:02.126300 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cdb564f3-3d2c-4698-ae5a-b42a4fdcba7c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:02.127074 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cdb564f3-3d2c-4698-ae5a-b42a4fdcba7c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:02.306566 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-cdb564f3-3d2c-4698-ae5a-b42a4fdcba7c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:02.334343 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-cdb564f3-3d2c-4698-ae5a-b42a4fdcba7c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1315 microversion: 2.1 time: 0.232259 Sep 05 12:30:02.342710 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 63/125] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:02 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:02.350136 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-b392b03c-afc6-4e8b-adb5-b7d17164999f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:02.360547 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-b392b03c-afc6-4e8b-adb5-b7d17164999f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:02.363305 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-b392b03c-afc6-4e8b-adb5-b7d17164999f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:02.365327 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-b392b03c-afc6-4e8b-adb5-b7d17164999f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1406 microversion: 2.20 time: 0.440897 Sep 05 12:30:02.379231 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 63/126] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:30:01 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1406 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:30:02.522017 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-51347075-43cf-42c8-8faa-442a48973800 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:02.523752 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-51347075-43cf-42c8-8faa-442a48973800 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:02.530927 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-51347075-43cf-42c8-8faa-442a48973800 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:02.531684 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-51347075-43cf-42c8-8faa-442a48973800 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:02.532221 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-51347075-43cf-42c8-8faa-442a48973800 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:02.533007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-51347075-43cf-42c8-8faa-442a48973800 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:02.533873 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-51347075-43cf-42c8-8faa-442a48973800 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:02.534387 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-51347075-43cf-42c8-8faa-442a48973800 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:02.733727 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-83143bad-f4b3-43a6-b02f-47c360583138 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:02.736102 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-83143bad-f4b3-43a6-b02f-47c360583138 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:02.751614 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-83143bad-f4b3-43a6-b02f-47c360583138 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:02.752106 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-83143bad-f4b3-43a6-b02f-47c360583138 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:02.757409 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-83143bad-f4b3-43a6-b02f-47c360583138 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:02.758663 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-83143bad-f4b3-43a6-b02f-47c360583138 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:02.764732 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-83143bad-f4b3-43a6-b02f-47c360583138 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:02.765270 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-83143bad-f4b3-43a6-b02f-47c360583138 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:02.779634 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-51347075-43cf-42c8-8faa-442a48973800 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:02.798137 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-51347075-43cf-42c8-8faa-442a48973800 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1367 microversion: 2.1 time: 0.280304 Sep 05 12:30:02.799162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 64/127] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:02 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:03.035953 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-83143bad-f4b3-43a6-b02f-47c360583138 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:03.042015 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-83143bad-f4b3-43a6-b02f-47c360583138 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.314763 Sep 05 12:30:03.042563 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 64/128] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:02 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:30:03.365883 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-6ec21e41-1d6e-4f2a-94f3-95f8d1cd8a11 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:03.366798 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-6ec21e41-1d6e-4f2a-94f3-95f8d1cd8a11 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:03.373252 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6ec21e41-1d6e-4f2a-94f3-95f8d1cd8a11 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:03.373930 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6ec21e41-1d6e-4f2a-94f3-95f8d1cd8a11 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:03.374489 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6ec21e41-1d6e-4f2a-94f3-95f8d1cd8a11 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:03.375443 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6ec21e41-1d6e-4f2a-94f3-95f8d1cd8a11 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:03.376024 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6ec21e41-1d6e-4f2a-94f3-95f8d1cd8a11 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:03.376747 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6ec21e41-1d6e-4f2a-94f3-95f8d1cd8a11 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:03.402546 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-20be0edb-b9bc-444b-88e5-b7b2a8ef1d0b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:03.403320 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-20be0edb-b9bc-444b-88e5-b7b2a8ef1d0b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:03.409935 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-20be0edb-b9bc-444b-88e5-b7b2a8ef1d0b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:03.412089 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-20be0edb-b9bc-444b-88e5-b7b2a8ef1d0b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:03.412535 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-20be0edb-b9bc-444b-88e5-b7b2a8ef1d0b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:03.413276 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-20be0edb-b9bc-444b-88e5-b7b2a8ef1d0b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:03.413722 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-20be0edb-b9bc-444b-88e5-b7b2a8ef1d0b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:03.414139 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-20be0edb-b9bc-444b-88e5-b7b2a8ef1d0b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:03.539946 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6ec21e41-1d6e-4f2a-94f3-95f8d1cd8a11 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:03.549516 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-6ec21e41-1d6e-4f2a-94f3-95f8d1cd8a11 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1315 microversion: 2.1 time: 0.187935 Sep 05 12:30:03.550443 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 65/129] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:03 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:03.625923 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-20be0edb-b9bc-444b-88e5-b7b2a8ef1d0b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:03.646244 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-20be0edb-b9bc-444b-88e5-b7b2a8ef1d0b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:03.648572 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-20be0edb-b9bc-444b-88e5-b7b2a8ef1d0b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:03.653183 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-20be0edb-b9bc-444b-88e5-b7b2a8ef1d0b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1406 microversion: 2.20 time: 0.264996 Sep 05 12:30:03.654890 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 65/130] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:30:03 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:30:03.826625 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-85f32dea-40e7-4383-b8b1-634d214be1b0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:03.827527 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-85f32dea-40e7-4383-b8b1-634d214be1b0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:03.838536 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-85f32dea-40e7-4383-b8b1-634d214be1b0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:03.838536 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-85f32dea-40e7-4383-b8b1-634d214be1b0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:03.839023 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-85f32dea-40e7-4383-b8b1-634d214be1b0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:03.840519 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-85f32dea-40e7-4383-b8b1-634d214be1b0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:03.841198 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-85f32dea-40e7-4383-b8b1-634d214be1b0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:03.842094 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-85f32dea-40e7-4383-b8b1-634d214be1b0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:03.851859 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-bbbe50a6-e7d2-480d-8f74-aa4b8eddede4 req-3d2536aa-d68c-4506-93f8-f85bc9db285d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79b6762-27f0-4044-bed9-bd1f6d1ba687", "name": "network-vif-plugged", "status": "completed", "tag": "cd04259f-c361-432d-b45e-05d24550b093"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:30:03.873147 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-bbbe50a6-e7d2-480d-8f74-aa4b8eddede4 req-3d2536aa-d68c-4506-93f8-f85bc9db285d service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:03.873962 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-bbbe50a6-e7d2-480d-8f74-aa4b8eddede4 req-3d2536aa-d68c-4506-93f8-f85bc9db285d service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:03.874978 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-bbbe50a6-e7d2-480d-8f74-aa4b8eddede4 req-3d2536aa-d68c-4506-93f8-f85bc9db285d service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:03.900740 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-bbbe50a6-e7d2-480d-8f74-aa4b8eddede4 req-3d2536aa-d68c-4506-93f8-f85bc9db285d service nova] Creating event network-vif-plugged:cd04259f-c361-432d-b45e-05d24550b093 for instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 on hv-cinder-80135 Sep 05 12:30:03.901938 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-bbbe50a6-e7d2-480d-8f74-aa4b8eddede4 req-3d2536aa-d68c-4506-93f8-f85bc9db285d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 05 12:30:03.902524 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-bbbe50a6-e7d2-480d-8f74-aa4b8eddede4 req-3d2536aa-d68c-4506-93f8-f85bc9db285d service nova] Acquired lock "compute-rpcapi-router" {{(pid=121210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 05 12:30:03.904087 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b201d8cf-d959-4536-acb5-41ae921115e3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:03.904799 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b201d8cf-d959-4536-acb5-41ae921115e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:03.905565 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b201d8cf-d959-4536-acb5-41ae921115e3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:03.906787 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b201d8cf-d959-4536-acb5-41ae921115e3 None None] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:03.907432 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b201d8cf-d959-4536-acb5-41ae921115e3 None None] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:03.908075 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b201d8cf-d959-4536-acb5-41ae921115e3 None None] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:03.922843 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.compute.rpcapi [None req-b201d8cf-d959-4536-acb5-41ae921115e3 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 05 12:30:03.924399 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b201d8cf-d959-4536-acb5-41ae921115e3 None None] Releasing lock "compute-rpcapi-router" {{(pid=121210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 05 12:30:03.949641 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-b201d8cf-d959-4536-acb5-41ae921115e3 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177852 Sep 05 12:30:03.952399 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 66/131] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:30:04.020658 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-85f32dea-40e7-4383-b8b1-634d214be1b0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:04.034470 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-85f32dea-40e7-4383-b8b1-634d214be1b0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1367 microversion: 2.1 time: 0.212546 Sep 05 12:30:04.037902 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 66/132] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:03 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:04.068498 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-40c2e2bf-a27f-4ba6-8ab1-ecb2ac355046 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:04.069796 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-40c2e2bf-a27f-4ba6-8ab1-ecb2ac355046 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:04.077389 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-40c2e2bf-a27f-4ba6-8ab1-ecb2ac355046 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:04.078304 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-40c2e2bf-a27f-4ba6-8ab1-ecb2ac355046 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:04.079075 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-40c2e2bf-a27f-4ba6-8ab1-ecb2ac355046 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:04.079876 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-40c2e2bf-a27f-4ba6-8ab1-ecb2ac355046 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:04.080588 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-40c2e2bf-a27f-4ba6-8ab1-ecb2ac355046 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:04.081659 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-40c2e2bf-a27f-4ba6-8ab1-ecb2ac355046 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:04.311814 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-40c2e2bf-a27f-4ba6-8ab1-ecb2ac355046 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:04.322574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-40c2e2bf-a27f-4ba6-8ab1-ecb2ac355046 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.259685 Sep 05 12:30:04.323419 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 67/133] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:04 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:04.577946 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8c194abb-77a5-4cf2-b431-1bb4c909e48c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:04.578565 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-8c194abb-77a5-4cf2-b431-1bb4c909e48c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:04.585082 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8c194abb-77a5-4cf2-b431-1bb4c909e48c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:04.585638 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8c194abb-77a5-4cf2-b431-1bb4c909e48c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:04.586163 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8c194abb-77a5-4cf2-b431-1bb4c909e48c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:04.586915 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8c194abb-77a5-4cf2-b431-1bb4c909e48c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:04.587445 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8c194abb-77a5-4cf2-b431-1bb4c909e48c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:04.588166 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8c194abb-77a5-4cf2-b431-1bb4c909e48c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:04.697284 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-24307641-d7c4-4eeb-bd0e-77a1d5a3e936 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:04.698598 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-24307641-d7c4-4eeb-bd0e-77a1d5a3e936 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:04.723458 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-24307641-d7c4-4eeb-bd0e-77a1d5a3e936 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:04.724218 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-24307641-d7c4-4eeb-bd0e-77a1d5a3e936 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:04.725320 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-24307641-d7c4-4eeb-bd0e-77a1d5a3e936 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:04.726024 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-24307641-d7c4-4eeb-bd0e-77a1d5a3e936 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:04.727138 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-24307641-d7c4-4eeb-bd0e-77a1d5a3e936 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:04.727750 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-24307641-d7c4-4eeb-bd0e-77a1d5a3e936 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:04.860094 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-8c194abb-77a5-4cf2-b431-1bb4c909e48c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:04.868716 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-8c194abb-77a5-4cf2-b431-1bb4c909e48c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1315 microversion: 2.1 time: 0.294761 Sep 05 12:30:04.869300 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 67/134] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:04 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:04.894277 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-24307641-d7c4-4eeb-bd0e-77a1d5a3e936 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:04.907269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-24307641-d7c4-4eeb-bd0e-77a1d5a3e936 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:04.908898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-24307641-d7c4-4eeb-bd0e-77a1d5a3e936 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:04.910173 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-24307641-d7c4-4eeb-bd0e-77a1d5a3e936 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1406 microversion: 2.20 time: 0.218145 Sep 05 12:30:04.920573 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 68/135] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:30:04 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:30:05.060904 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e4713f42-3b74-4d9d-aba7-9535c93b6298 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:05.061515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e4713f42-3b74-4d9d-aba7-9535c93b6298 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:05.074238 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e4713f42-3b74-4d9d-aba7-9535c93b6298 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:05.074720 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e4713f42-3b74-4d9d-aba7-9535c93b6298 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:05.075208 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e4713f42-3b74-4d9d-aba7-9535c93b6298 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:05.076393 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e4713f42-3b74-4d9d-aba7-9535c93b6298 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:05.076850 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e4713f42-3b74-4d9d-aba7-9535c93b6298 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:05.077266 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e4713f42-3b74-4d9d-aba7-9535c93b6298 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:05.254471 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e4713f42-3b74-4d9d-aba7-9535c93b6298 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:05.262339 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e4713f42-3b74-4d9d-aba7-9535c93b6298 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1367 microversion: 2.1 time: 0.205605 Sep 05 12:30:05.262908 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 68/136] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:05 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:30:05.346396 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-42a39274-1b7b-443a-a3c5-fd6bcba6e890 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:05.347006 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-42a39274-1b7b-443a-a3c5-fd6bcba6e890 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:05.354079 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-42a39274-1b7b-443a-a3c5-fd6bcba6e890 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:05.354561 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-42a39274-1b7b-443a-a3c5-fd6bcba6e890 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:05.355006 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-42a39274-1b7b-443a-a3c5-fd6bcba6e890 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:05.355728 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-42a39274-1b7b-443a-a3c5-fd6bcba6e890 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:05.356164 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-42a39274-1b7b-443a-a3c5-fd6bcba6e890 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:05.356576 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-42a39274-1b7b-443a-a3c5-fd6bcba6e890 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:05.361625 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=100 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:05.522546 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-42a39274-1b7b-443a-a3c5-fd6bcba6e890 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:05.532450 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-42a39274-1b7b-443a-a3c5-fd6bcba6e890 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.189498 Sep 05 12:30:05.533463 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 69/137] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:05 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:05.897548 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e025f106-746b-4333-82c3-5342c6775b4d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:05.898554 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e025f106-746b-4333-82c3-5342c6775b4d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:05.911607 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e025f106-746b-4333-82c3-5342c6775b4d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:05.914602 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e025f106-746b-4333-82c3-5342c6775b4d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:05.914602 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e025f106-746b-4333-82c3-5342c6775b4d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:05.916588 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e025f106-746b-4333-82c3-5342c6775b4d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:05.918267 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e025f106-746b-4333-82c3-5342c6775b4d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:05.919397 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e025f106-746b-4333-82c3-5342c6775b4d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:05.944883 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-c5ae6d84-24d4-40a9-9af8-0e69dba17df3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:05.948162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-c5ae6d84-24d4-40a9-9af8-0e69dba17df3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:05.971884 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c5ae6d84-24d4-40a9-9af8-0e69dba17df3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:05.975231 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c5ae6d84-24d4-40a9-9af8-0e69dba17df3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:06.029523 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c5ae6d84-24d4-40a9-9af8-0e69dba17df3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:06.029523 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c5ae6d84-24d4-40a9-9af8-0e69dba17df3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:06.029523 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c5ae6d84-24d4-40a9-9af8-0e69dba17df3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:06.029523 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c5ae6d84-24d4-40a9-9af8-0e69dba17df3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:06.372605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c5ae6d84-24d4-40a9-9af8-0e69dba17df3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:06.390145 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c5ae6d84-24d4-40a9-9af8-0e69dba17df3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:06.394643 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c5ae6d84-24d4-40a9-9af8-0e69dba17df3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:06.413076 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-c5ae6d84-24d4-40a9-9af8-0e69dba17df3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1406 microversion: 2.20 time: 0.477548 Sep 05 12:30:06.420156 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 70/138] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:30:05 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1406 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:30:06.435472 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-063b48a7-f7e1-4714-bc8f-f5b7adaab1e1 req-61cddd43-b250-4fd3-954b-df93ce4fd3bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0815c135-ccc0-412c-b960-1dba28e7b455", "name": "network-vif-plugged", "status": "completed", "tag": "b48abd9f-ccdb-4cd2-a0d6-bc38fac6b27f"}, {"server_uuid": "83fdb4c3-ab13-406e-8f5c-a8a7e481374f", "name": "network-vif-plugged", "status": "completed", "tag": "5d2944c4-c65b-49e5-b532-6867e3db6d0c"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:30:06.462363 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-063b48a7-f7e1-4714-bc8f-f5b7adaab1e1 req-61cddd43-b250-4fd3-954b-df93ce4fd3bd service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:06.463325 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-063b48a7-f7e1-4714-bc8f-f5b7adaab1e1 req-61cddd43-b250-4fd3-954b-df93ce4fd3bd service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:06.464016 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-063b48a7-f7e1-4714-bc8f-f5b7adaab1e1 req-61cddd43-b250-4fd3-954b-df93ce4fd3bd service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:06.499344 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-063b48a7-f7e1-4714-bc8f-f5b7adaab1e1 req-61cddd43-b250-4fd3-954b-df93ce4fd3bd service nova] Creating event network-vif-plugged:b48abd9f-ccdb-4cd2-a0d6-bc38fac6b27f for instance 0815c135-ccc0-412c-b960-1dba28e7b455 on hv-cinder-80135 Sep 05 12:30:06.505054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-063b48a7-f7e1-4714-bc8f-f5b7adaab1e1 req-61cddd43-b250-4fd3-954b-df93ce4fd3bd service nova] Creating event network-vif-plugged:5d2944c4-c65b-49e5-b532-6867e3db6d0c for instance 83fdb4c3-ab13-406e-8f5c-a8a7e481374f on hv-cinder-80135 Sep 05 12:30:06.534119 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-063b48a7-f7e1-4714-bc8f-f5b7adaab1e1 req-61cddd43-b250-4fd3-954b-df93ce4fd3bd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.111830 Sep 05 12:30:06.534790 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 71/139] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:30:06.541355 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e10fd4a3-e73d-45da-9660-1f4fc2f2d8a8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:06.542174 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-e10fd4a3-e73d-45da-9660-1f4fc2f2d8a8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:06.550756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e10fd4a3-e73d-45da-9660-1f4fc2f2d8a8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:06.551646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e10fd4a3-e73d-45da-9660-1f4fc2f2d8a8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:06.553135 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e10fd4a3-e73d-45da-9660-1f4fc2f2d8a8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:06.553760 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e10fd4a3-e73d-45da-9660-1f4fc2f2d8a8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:06.554216 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e10fd4a3-e73d-45da-9660-1f4fc2f2d8a8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:06.554998 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e10fd4a3-e73d-45da-9660-1f4fc2f2d8a8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:06.669414 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e025f106-746b-4333-82c3-5342c6775b4d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:06.722863 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e025f106-746b-4333-82c3-5342c6775b4d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1315 microversion: 2.1 time: 0.822986 Sep 05 12:30:06.725671 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 69/140] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:05 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1315 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:30:06.736484 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1368aa8b-853f-468d-86e0-515b1870d45b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:06.737358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1368aa8b-853f-468d-86e0-515b1870d45b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:06.797744 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1368aa8b-853f-468d-86e0-515b1870d45b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:06.802573 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1368aa8b-853f-468d-86e0-515b1870d45b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:06.808279 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1368aa8b-853f-468d-86e0-515b1870d45b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:06.812823 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1368aa8b-853f-468d-86e0-515b1870d45b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:06.815634 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1368aa8b-853f-468d-86e0-515b1870d45b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:06.816900 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1368aa8b-853f-468d-86e0-515b1870d45b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:06.862336 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-e10fd4a3-e73d-45da-9660-1f4fc2f2d8a8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:06.874624 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-e10fd4a3-e73d-45da-9660-1f4fc2f2d8a8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1367 microversion: 2.1 time: 0.338533 Sep 05 12:30:06.875218 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 72/141] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:06 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1367 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:07.109824 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1368aa8b-853f-468d-86e0-515b1870d45b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:07.119745 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1368aa8b-853f-468d-86e0-515b1870d45b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.392520 Sep 05 12:30:07.130193 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 70/142] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:06 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:07.438833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-29998340-081e-44f1-81bf-589113841fdf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:07.439633 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-29998340-081e-44f1-81bf-589113841fdf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:07.445574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-29998340-081e-44f1-81bf-589113841fdf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:07.446044 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-29998340-081e-44f1-81bf-589113841fdf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:07.446667 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-29998340-081e-44f1-81bf-589113841fdf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:07.447352 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-29998340-081e-44f1-81bf-589113841fdf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:07.447846 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-29998340-081e-44f1-81bf-589113841fdf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:07.448266 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-29998340-081e-44f1-81bf-589113841fdf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:07.604589 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-29998340-081e-44f1-81bf-589113841fdf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:07.613052 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-29998340-081e-44f1-81bf-589113841fdf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:07.614749 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-29998340-081e-44f1-81bf-589113841fdf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:07.616066 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-29998340-081e-44f1-81bf-589113841fdf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1406 microversion: 2.20 time: 0.181093 Sep 05 12:30:07.617170 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 73/143] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:30:07 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:30:07.776616 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e02a9dd0-38e0-4cdb-948a-ac23ccb3dbef tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:07.777562 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e02a9dd0-38e0-4cdb-948a-ac23ccb3dbef tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:07.786501 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e02a9dd0-38e0-4cdb-948a-ac23ccb3dbef tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:07.787127 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e02a9dd0-38e0-4cdb-948a-ac23ccb3dbef tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:07.793640 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e02a9dd0-38e0-4cdb-948a-ac23ccb3dbef tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:07.793640 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e02a9dd0-38e0-4cdb-948a-ac23ccb3dbef tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:07.793640 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e02a9dd0-38e0-4cdb-948a-ac23ccb3dbef tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:07.793640 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e02a9dd0-38e0-4cdb-948a-ac23ccb3dbef tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:07.916862 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-bd29ce37-d756-47c3-a895-477b923449ce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:07.917700 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-bd29ce37-d756-47c3-a895-477b923449ce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:07.924176 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bd29ce37-d756-47c3-a895-477b923449ce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:07.924699 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bd29ce37-d756-47c3-a895-477b923449ce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:07.925131 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bd29ce37-d756-47c3-a895-477b923449ce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:07.925815 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bd29ce37-d756-47c3-a895-477b923449ce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:07.926256 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bd29ce37-d756-47c3-a895-477b923449ce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:07.926868 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bd29ce37-d756-47c3-a895-477b923449ce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:07.939420 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e02a9dd0-38e0-4cdb-948a-ac23ccb3dbef tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:07.947596 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e02a9dd0-38e0-4cdb-948a-ac23ccb3dbef tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1502 microversion: 2.1 time: 0.178772 Sep 05 12:30:07.949899 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 71/144] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:07 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1502 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:08.128662 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-bd29ce37-d756-47c3-a895-477b923449ce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:08.147312 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-bd29ce37-d756-47c3-a895-477b923449ce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1367 microversion: 2.1 time: 0.234178 Sep 05 12:30:08.148739 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 74/145] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:07 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:30:08.152985 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-b5610129-6714-452a-b97c-c05409ed2f52 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:08.154408 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-b5610129-6714-452a-b97c-c05409ed2f52 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:08.163152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b5610129-6714-452a-b97c-c05409ed2f52 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:08.164080 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b5610129-6714-452a-b97c-c05409ed2f52 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:08.164508 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b5610129-6714-452a-b97c-c05409ed2f52 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:08.165214 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b5610129-6714-452a-b97c-c05409ed2f52 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:08.165665 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b5610129-6714-452a-b97c-c05409ed2f52 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:08.166096 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b5610129-6714-452a-b97c-c05409ed2f52 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:08.346686 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-b5610129-6714-452a-b97c-c05409ed2f52 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:08.361250 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-b5610129-6714-452a-b97c-c05409ed2f52 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.211874 Sep 05 12:30:08.362364 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 72/146] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:08 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:30:08.564160 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-087ca796-2bbc-4d07-bf3f-d635c4553f1c req-cbdf3801-9e4a-4411-b53a-b56a3b5a33ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2", "name": "network-vif-plugged", "status": "completed", "tag": "2941d715-09fe-449b-bed5-764f516010b2"}, {"server_uuid": "a0105c66-6939-4b6d-b774-c1821012c1f0", "name": "network-vif-plugged", "status": "completed", "tag": "09dffb1b-f334-42d1-bd74-8b59ed4648c3"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:30:08.592995 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-087ca796-2bbc-4d07-bf3f-d635c4553f1c req-cbdf3801-9e4a-4411-b53a-b56a3b5a33ad service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:08.594009 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-087ca796-2bbc-4d07-bf3f-d635c4553f1c req-cbdf3801-9e4a-4411-b53a-b56a3b5a33ad service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:08.594809 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-087ca796-2bbc-4d07-bf3f-d635c4553f1c req-cbdf3801-9e4a-4411-b53a-b56a3b5a33ad service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:08.631077 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-087ca796-2bbc-4d07-bf3f-d635c4553f1c req-cbdf3801-9e4a-4411-b53a-b56a3b5a33ad service nova] Creating event network-vif-plugged:2941d715-09fe-449b-bed5-764f516010b2 for instance f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 on hv-cinder-80135 Sep 05 12:30:08.631861 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-087ca796-2bbc-4d07-bf3f-d635c4553f1c req-cbdf3801-9e4a-4411-b53a-b56a3b5a33ad service nova] Creating event network-vif-plugged:09dffb1b-f334-42d1-bd74-8b59ed4648c3 for instance a0105c66-6939-4b6d-b774-c1821012c1f0 on hv-cinder-80135 Sep 05 12:30:08.652567 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a679fc61-fe1a-4ac3-b74a-f76e0bc91f49 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:08.654485 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a679fc61-fe1a-4ac3-b74a-f76e0bc91f49 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:08.656421 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-087ca796-2bbc-4d07-bf3f-d635c4553f1c req-cbdf3801-9e4a-4411-b53a-b56a3b5a33ad service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.104875 Sep 05 12:30:08.663634 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 75/147] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:30:08.670915 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a679fc61-fe1a-4ac3-b74a-f76e0bc91f49 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:08.672495 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a679fc61-fe1a-4ac3-b74a-f76e0bc91f49 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:08.673590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a679fc61-fe1a-4ac3-b74a-f76e0bc91f49 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:08.675001 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a679fc61-fe1a-4ac3-b74a-f76e0bc91f49 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:08.675998 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a679fc61-fe1a-4ac3-b74a-f76e0bc91f49 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:08.677451 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a679fc61-fe1a-4ac3-b74a-f76e0bc91f49 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:08.950502 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a679fc61-fe1a-4ac3-b74a-f76e0bc91f49 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:08.962180 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a679fc61-fe1a-4ac3-b74a-f76e0bc91f49 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:08.963863 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a679fc61-fe1a-4ac3-b74a-f76e0bc91f49 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:08.965469 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a679fc61-fe1a-4ac3-b74a-f76e0bc91f49 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1406 microversion: 2.20 time: 0.325592 Sep 05 12:30:08.966703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 73/148] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:30:08 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1406 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:30:09.173991 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-954ac672-670e-474a-875e-765b74407dd6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:09.174704 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-954ac672-670e-474a-875e-765b74407dd6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:09.189203 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-954ac672-670e-474a-875e-765b74407dd6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:09.189927 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-954ac672-670e-474a-875e-765b74407dd6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:09.190526 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-954ac672-670e-474a-875e-765b74407dd6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:09.192936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-954ac672-670e-474a-875e-765b74407dd6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:09.193438 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-954ac672-670e-474a-875e-765b74407dd6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:09.193857 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-954ac672-670e-474a-875e-765b74407dd6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:09.392388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-797f9d7e-eb91-4afc-aed8-31a2c11c07dd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:09.393567 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-797f9d7e-eb91-4afc-aed8-31a2c11c07dd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:09.405825 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-797f9d7e-eb91-4afc-aed8-31a2c11c07dd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:09.412477 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-954ac672-670e-474a-875e-765b74407dd6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:09.418354 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-797f9d7e-eb91-4afc-aed8-31a2c11c07dd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:09.419190 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-797f9d7e-eb91-4afc-aed8-31a2c11c07dd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:09.420452 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-797f9d7e-eb91-4afc-aed8-31a2c11c07dd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:09.421272 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-797f9d7e-eb91-4afc-aed8-31a2c11c07dd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:09.422041 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-797f9d7e-eb91-4afc-aed8-31a2c11c07dd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:09.432259 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-954ac672-670e-474a-875e-765b74407dd6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1367 microversion: 2.1 time: 0.263031 Sep 05 12:30:09.439056 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 76/149] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:09 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:09.570732 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-797f9d7e-eb91-4afc-aed8-31a2c11c07dd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:09.580996 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-797f9d7e-eb91-4afc-aed8-31a2c11c07dd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.198728 Sep 05 12:30:09.581880 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 74/150] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:09 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:10.011751 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-b2f6c690-5d6e-47ab-bc6a-7e2cadc71cac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:10.012983 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-b2f6c690-5d6e-47ab-bc6a-7e2cadc71cac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:10.021013 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b2f6c690-5d6e-47ab-bc6a-7e2cadc71cac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:10.021755 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b2f6c690-5d6e-47ab-bc6a-7e2cadc71cac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:10.022189 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b2f6c690-5d6e-47ab-bc6a-7e2cadc71cac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:10.023057 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b2f6c690-5d6e-47ab-bc6a-7e2cadc71cac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:10.023818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b2f6c690-5d6e-47ab-bc6a-7e2cadc71cac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:10.024388 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b2f6c690-5d6e-47ab-bc6a-7e2cadc71cac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:10.200054 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-020174a3-fe25-4748-a5ad-bea97a12d08d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59839ae5-e29c-4184-b818-01aa697c2884"}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:30:10.203775 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-b2f6c690-5d6e-47ab-bc6a-7e2cadc71cac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:10.219332 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-b2f6c690-5d6e-47ab-bc6a-7e2cadc71cac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:10.219850 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-020174a3-fe25-4748-a5ad-bea97a12d08d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:10.225434 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-b2f6c690-5d6e-47ab-bc6a-7e2cadc71cac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:10.226642 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-b2f6c690-5d6e-47ab-bc6a-7e2cadc71cac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1406 microversion: 2.20 time: 0.219280 Sep 05 12:30:10.230568 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-020174a3-fe25-4748-a5ad-bea97a12d08d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:10.231257 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-020174a3-fe25-4748-a5ad-bea97a12d08d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:10.232084 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 77/151] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:30:10 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:30:10.246761 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-020174a3-fe25-4748-a5ad-bea97a12d08d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:10.246761 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-020174a3-fe25-4748-a5ad-bea97a12d08d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:10.246761 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-020174a3-fe25-4748-a5ad-bea97a12d08d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:10.246761 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-020174a3-fe25-4748-a5ad-bea97a12d08d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:10.460074 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-343f720c-42fc-4629-9ff6-cba6931dedfa tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:10.460775 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-343f720c-42fc-4629-9ff6-cba6931dedfa tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:10.469175 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-343f720c-42fc-4629-9ff6-cba6931dedfa tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:10.469649 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-343f720c-42fc-4629-9ff6-cba6931dedfa tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:10.470334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-343f720c-42fc-4629-9ff6-cba6931dedfa tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:10.471415 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-343f720c-42fc-4629-9ff6-cba6931dedfa tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:10.471903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-343f720c-42fc-4629-9ff6-cba6931dedfa tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:10.472683 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-343f720c-42fc-4629-9ff6-cba6931dedfa tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:10.656979 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-343f720c-42fc-4629-9ff6-cba6931dedfa tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:10.666293 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-343f720c-42fc-4629-9ff6-cba6931dedfa tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1557 microversion: 2.1 time: 0.212864 Sep 05 12:30:10.667318 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 78/152] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:10 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:10.672938 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-c3f7c2df-3184-48e6-b8d1-585f253eca17 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:10.673741 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-c3f7c2df-3184-48e6-b8d1-585f253eca17 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:10.680375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c3f7c2df-3184-48e6-b8d1-585f253eca17 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:10.680992 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c3f7c2df-3184-48e6-b8d1-585f253eca17 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:10.682036 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c3f7c2df-3184-48e6-b8d1-585f253eca17 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:10.682840 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c3f7c2df-3184-48e6-b8d1-585f253eca17 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:10.683576 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c3f7c2df-3184-48e6-b8d1-585f253eca17 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:10.684084 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c3f7c2df-3184-48e6-b8d1-585f253eca17 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:10.952093 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c3f7c2df-3184-48e6-b8d1-585f253eca17 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:10.964268 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-c3f7c2df-3184-48e6-b8d1-585f253eca17 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.295850 Sep 05 12:30:10.965541 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 79/153] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:10 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:10.972338 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-733076ba-d53e-4fad-a604-803b5848fbaa tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:10.972983 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-733076ba-d53e-4fad-a604-803b5848fbaa tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:10.981515 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-733076ba-d53e-4fad-a604-803b5848fbaa tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:10.982003 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-733076ba-d53e-4fad-a604-803b5848fbaa tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:10.985322 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-733076ba-d53e-4fad-a604-803b5848fbaa tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:10.985322 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-733076ba-d53e-4fad-a604-803b5848fbaa tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:10.985322 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-733076ba-d53e-4fad-a604-803b5848fbaa tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:10.985322 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-733076ba-d53e-4fad-a604-803b5848fbaa tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:11.110278 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-733076ba-d53e-4fad-a604-803b5848fbaa tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143147 Sep 05 12:30:11.110858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 80/154] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Sep 5 12:30:10 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:30:11.266359 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4d4db5e1-a5b3-45aa-b909-25a000c5d660 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:11.266967 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-4d4db5e1-a5b3-45aa-b909-25a000c5d660 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:11.280403 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d4db5e1-a5b3-45aa-b909-25a000c5d660 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:11.280899 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d4db5e1-a5b3-45aa-b909-25a000c5d660 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:11.283026 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d4db5e1-a5b3-45aa-b909-25a000c5d660 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:11.283949 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d4db5e1-a5b3-45aa-b909-25a000c5d660 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:11.285559 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d4db5e1-a5b3-45aa-b909-25a000c5d660 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:11.287126 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d4db5e1-a5b3-45aa-b909-25a000c5d660 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:11.421324 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:11.641826 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-020174a3-fe25-4748-a5ad-bea97a12d08d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "POST /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.446142 Sep 05 12:30:11.650980 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 75/155] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Sep 5 12:30:10 2022] POST /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687/os-volume_attachments => generated 194 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:30:11.651429 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-4d4db5e1-a5b3-45aa-b909-25a000c5d660 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:11.667848 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-4d4db5e1-a5b3-45aa-b909-25a000c5d660 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:11.675153 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-4d4db5e1-a5b3-45aa-b909-25a000c5d660 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:11.676477 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-4d4db5e1-a5b3-45aa-b909-25a000c5d660 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1406 microversion: 2.20 time: 0.413888 Sep 05 12:30:11.677394 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 81/156] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:30:11 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1406 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:30:11.999351 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-76cd22be-1af2-43eb-a4eb-8b6363c141e1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:12.000371 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-76cd22be-1af2-43eb-a4eb-8b6363c141e1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:12.012311 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-76cd22be-1af2-43eb-a4eb-8b6363c141e1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:12.013177 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-76cd22be-1af2-43eb-a4eb-8b6363c141e1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:12.013804 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-76cd22be-1af2-43eb-a4eb-8b6363c141e1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:12.014748 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-76cd22be-1af2-43eb-a4eb-8b6363c141e1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:12.015326 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-76cd22be-1af2-43eb-a4eb-8b6363c141e1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:12.018084 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-76cd22be-1af2-43eb-a4eb-8b6363c141e1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:12.338636 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-76cd22be-1af2-43eb-a4eb-8b6363c141e1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:12.387640 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-76cd22be-1af2-43eb-a4eb-8b6363c141e1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1321 microversion: 2.1 time: 0.398010 Sep 05 12:30:12.393029 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 76/157] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:11 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1321 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:12.724906 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-f6c98a80-c754-447c-a926-d746bd988a69 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:12.728359 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-f6c98a80-c754-447c-a926-d746bd988a69 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:12.741530 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f6c98a80-c754-447c-a926-d746bd988a69 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:12.743756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f6c98a80-c754-447c-a926-d746bd988a69 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:12.745790 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f6c98a80-c754-447c-a926-d746bd988a69 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:12.746686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f6c98a80-c754-447c-a926-d746bd988a69 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:12.748715 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f6c98a80-c754-447c-a926-d746bd988a69 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:12.753712 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f6c98a80-c754-447c-a926-d746bd988a69 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:13.021590 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f6c98a80-c754-447c-a926-d746bd988a69 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:13.030451 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f6c98a80-c754-447c-a926-d746bd988a69 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:13.031946 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f6c98a80-c754-447c-a926-d746bd988a69 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:13.033118 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-f6c98a80-c754-447c-a926-d746bd988a69 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1597 microversion: 2.20 time: 0.312251 Sep 05 12:30:13.037319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 82/158] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:30:12 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1597 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:30:13.060924 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-6b62f19a-7ff5-4575-9f72-e3218434ce0c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:13.062180 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-6b62f19a-7ff5-4575-9f72-e3218434ce0c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:13.069896 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=89 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:13.071640 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6b62f19a-7ff5-4575-9f72-e3218434ce0c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:13.072268 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6b62f19a-7ff5-4575-9f72-e3218434ce0c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:13.072844 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6b62f19a-7ff5-4575-9f72-e3218434ce0c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:13.073723 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6b62f19a-7ff5-4575-9f72-e3218434ce0c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:13.074317 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6b62f19a-7ff5-4575-9f72-e3218434ce0c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:13.074877 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6b62f19a-7ff5-4575-9f72-e3218434ce0c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:13.169346 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-6b62f19a-7ff5-4575-9f72-e3218434ce0c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.113044 Sep 05 12:30:13.170096 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 77/159] 10.222.0.62 () {60 vars in 1316 bytes} [Mon Sep 5 12:30:13 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:30:13.416648 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-430b6e54-386a-40ee-8ad6-88cab6319356 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:13.423700 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-430b6e54-386a-40ee-8ad6-88cab6319356 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:13.425668 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-368b92ea-e058-437f-b715-cf8eacf4fd70 req-5f073803-73f7-43e2-beb3-56f303f07c00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0815c135-ccc0-412c-b960-1dba28e7b455", "tag": "b48abd9f-ccdb-4cd2-a0d6-bc38fac6b27f"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:30:13.440329 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-430b6e54-386a-40ee-8ad6-88cab6319356 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:13.441083 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-430b6e54-386a-40ee-8ad6-88cab6319356 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:13.443875 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-368b92ea-e058-437f-b715-cf8eacf4fd70 req-5f073803-73f7-43e2-beb3-56f303f07c00 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:13.444590 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-430b6e54-386a-40ee-8ad6-88cab6319356 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:13.445529 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-430b6e54-386a-40ee-8ad6-88cab6319356 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:13.446168 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-430b6e54-386a-40ee-8ad6-88cab6319356 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:13.448641 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-430b6e54-386a-40ee-8ad6-88cab6319356 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:13.450596 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-368b92ea-e058-437f-b715-cf8eacf4fd70 req-5f073803-73f7-43e2-beb3-56f303f07c00 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:13.451278 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-368b92ea-e058-437f-b715-cf8eacf4fd70 req-5f073803-73f7-43e2-beb3-56f303f07c00 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:13.479259 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-368b92ea-e058-437f-b715-cf8eacf4fd70 req-5f073803-73f7-43e2-beb3-56f303f07c00 service nova] Creating event network-changed:b48abd9f-ccdb-4cd2-a0d6-bc38fac6b27f for instance 0815c135-ccc0-412c-b960-1dba28e7b455 on hv-cinder-80135 Sep 05 12:30:13.490498 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-368b92ea-e058-437f-b715-cf8eacf4fd70 req-5f073803-73f7-43e2-beb3-56f303f07c00 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066150 Sep 05 12:30:13.491254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 78/160] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:30:13.921930 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=2 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:14.108079 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-430b6e54-386a-40ee-8ad6-88cab6319356 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:14.125600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-430b6e54-386a-40ee-8ad6-88cab6319356 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1516 microversion: 2.1 time: 0.713050 Sep 05 12:30:14.143900 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 83/161] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:13 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1516 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:14.153591 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f8b4d905-a1aa-45d0-9f5e-69d7de08e7cc tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:30:14.156511 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f8b4d905-a1aa-45d0-9f5e-69d7de08e7cc tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:14.183334 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f8b4d905-a1aa-45d0-9f5e-69d7de08e7cc tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:14.183334 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f8b4d905-a1aa-45d0-9f5e-69d7de08e7cc tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:14.183334 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f8b4d905-a1aa-45d0-9f5e-69d7de08e7cc tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:14.183334 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f8b4d905-a1aa-45d0-9f5e-69d7de08e7cc tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:14.183702 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f8b4d905-a1aa-45d0-9f5e-69d7de08e7cc tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:14.183702 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f8b4d905-a1aa-45d0-9f5e-69d7de08e7cc tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:14.241593 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.objects.instance [None req-f8b4d905-a1aa-45d0-9f5e-69d7de08e7cc tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lazy-loading 'flavor' on Instance uuid f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 {{(pid=121211) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:30:14.764930 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f8b4d905-a1aa-45d0-9f5e-69d7de08e7cc tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "POST /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2/action" status: 200 len: 32 microversion: 2.1 time: 0.617594 Sep 05 12:30:14.766101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 79/162] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Sep 5 12:30:14 2022] POST /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2/action => generated 32 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 12:30:14.778639 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d05b25c0-b79c-4278-991a-e74121401411 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:14.780146 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d05b25c0-b79c-4278-991a-e74121401411 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:14.792461 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d05b25c0-b79c-4278-991a-e74121401411 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:14.793428 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d05b25c0-b79c-4278-991a-e74121401411 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:14.794157 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d05b25c0-b79c-4278-991a-e74121401411 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:14.795584 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d05b25c0-b79c-4278-991a-e74121401411 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:14.796297 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d05b25c0-b79c-4278-991a-e74121401411 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:14.797252 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d05b25c0-b79c-4278-991a-e74121401411 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:15.152727 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d05b25c0-b79c-4278-991a-e74121401411 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:15.166018 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d05b25c0-b79c-4278-991a-e74121401411 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.393414 Sep 05 12:30:15.185901 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 84/163] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:14 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:15.541889 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-a9c794be-79ba-473c-b480-000c7e4786f3 req-be53c22c-2f0c-4561-aec5-936a9483e4ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0105c66-6939-4b6d-b774-c1821012c1f0", "tag": "09dffb1b-f334-42d1-bd74-8b59ed4648c3"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:30:15.574466 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-a9c794be-79ba-473c-b480-000c7e4786f3 req-be53c22c-2f0c-4561-aec5-936a9483e4ce service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:15.579454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-a9c794be-79ba-473c-b480-000c7e4786f3 req-be53c22c-2f0c-4561-aec5-936a9483e4ce service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:15.581052 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-a9c794be-79ba-473c-b480-000c7e4786f3 req-be53c22c-2f0c-4561-aec5-936a9483e4ce service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:15.603326 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-a9c794be-79ba-473c-b480-000c7e4786f3 req-be53c22c-2f0c-4561-aec5-936a9483e4ce service nova] Creating event network-changed:09dffb1b-f334-42d1-bd74-8b59ed4648c3 for instance a0105c66-6939-4b6d-b774-c1821012c1f0 on hv-cinder-80135 Sep 05 12:30:15.609535 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-a9c794be-79ba-473c-b480-000c7e4786f3 req-be53c22c-2f0c-4561-aec5-936a9483e4ce service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071661 Sep 05 12:30:15.610124 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 80/164] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:30:16.190744 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4441a7ef-fb01-4ac3-bb49-673cc8a319d6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:16.191690 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-4441a7ef-fb01-4ac3-bb49-673cc8a319d6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:16.201144 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4441a7ef-fb01-4ac3-bb49-673cc8a319d6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:16.204652 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4441a7ef-fb01-4ac3-bb49-673cc8a319d6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:16.226926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4441a7ef-fb01-4ac3-bb49-673cc8a319d6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:16.227779 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4441a7ef-fb01-4ac3-bb49-673cc8a319d6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:16.228271 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4441a7ef-fb01-4ac3-bb49-673cc8a319d6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:16.228705 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4441a7ef-fb01-4ac3-bb49-673cc8a319d6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:16.673334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-4441a7ef-fb01-4ac3-bb49-673cc8a319d6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:16.682109 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-4441a7ef-fb01-4ac3-bb49-673cc8a319d6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.495619 Sep 05 12:30:16.682715 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 85/165] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:16 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:17.709284 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1ca2cedd-98d9-4455-b8ee-4fbb1b3192d5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:17.710736 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1ca2cedd-98d9-4455-b8ee-4fbb1b3192d5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:17.722390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1ca2cedd-98d9-4455-b8ee-4fbb1b3192d5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:17.729561 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1ca2cedd-98d9-4455-b8ee-4fbb1b3192d5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:17.729561 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1ca2cedd-98d9-4455-b8ee-4fbb1b3192d5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:17.729561 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1ca2cedd-98d9-4455-b8ee-4fbb1b3192d5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:17.729561 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1ca2cedd-98d9-4455-b8ee-4fbb1b3192d5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:17.730024 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1ca2cedd-98d9-4455-b8ee-4fbb1b3192d5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:17.900915 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1ca2cedd-98d9-4455-b8ee-4fbb1b3192d5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:17.909595 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1ca2cedd-98d9-4455-b8ee-4fbb1b3192d5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.206241 Sep 05 12:30:17.910144 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 81/166] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:17 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:18.934114 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-9af73580-3ca7-4550-802b-d4e68e50ebfe tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:18.934822 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-9af73580-3ca7-4550-802b-d4e68e50ebfe tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:18.944126 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9af73580-3ca7-4550-802b-d4e68e50ebfe tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:18.947327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9af73580-3ca7-4550-802b-d4e68e50ebfe tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:18.947327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9af73580-3ca7-4550-802b-d4e68e50ebfe tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:18.947327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9af73580-3ca7-4550-802b-d4e68e50ebfe tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:18.947327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9af73580-3ca7-4550-802b-d4e68e50ebfe tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:18.947731 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9af73580-3ca7-4550-802b-d4e68e50ebfe tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:19.126115 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-9af73580-3ca7-4550-802b-d4e68e50ebfe tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:19.134892 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-9af73580-3ca7-4550-802b-d4e68e50ebfe tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.204709 Sep 05 12:30:19.146546 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 86/167] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:18 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:30:20.158147 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-49c5ef09-04a6-4ab0-ad0b-3428d1bb761b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:20.158874 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-49c5ef09-04a6-4ab0-ad0b-3428d1bb761b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:20.166526 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-49c5ef09-04a6-4ab0-ad0b-3428d1bb761b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:20.167092 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-49c5ef09-04a6-4ab0-ad0b-3428d1bb761b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:20.167550 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-49c5ef09-04a6-4ab0-ad0b-3428d1bb761b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:20.168259 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-49c5ef09-04a6-4ab0-ad0b-3428d1bb761b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:20.168701 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-49c5ef09-04a6-4ab0-ad0b-3428d1bb761b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:20.169128 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-49c5ef09-04a6-4ab0-ad0b-3428d1bb761b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:20.335880 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-49c5ef09-04a6-4ab0-ad0b-3428d1bb761b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:20.346477 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-49c5ef09-04a6-4ab0-ad0b-3428d1bb761b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.191885 Sep 05 12:30:20.347455 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 82/168] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:20 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:21.371071 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-6891b882-0248-4e1d-8346-c82636e2614a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:21.371652 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-6891b882-0248-4e1d-8346-c82636e2614a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:21.373783 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=95 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:21.378548 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6891b882-0248-4e1d-8346-c82636e2614a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:21.379243 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6891b882-0248-4e1d-8346-c82636e2614a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:21.379747 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6891b882-0248-4e1d-8346-c82636e2614a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:21.380450 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6891b882-0248-4e1d-8346-c82636e2614a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:21.380896 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6891b882-0248-4e1d-8346-c82636e2614a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:21.381486 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6891b882-0248-4e1d-8346-c82636e2614a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:21.410590 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=100 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:21.552456 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6891b882-0248-4e1d-8346-c82636e2614a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:21.560548 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-6891b882-0248-4e1d-8346-c82636e2614a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.193464 Sep 05 12:30:21.565805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 87/169] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:21 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:22.589173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4e640493-0c17-4fee-988e-52e0670cfd93 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:22.590288 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4e640493-0c17-4fee-988e-52e0670cfd93 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:22.602428 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4e640493-0c17-4fee-988e-52e0670cfd93 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:22.603290 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4e640493-0c17-4fee-988e-52e0670cfd93 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:22.604166 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4e640493-0c17-4fee-988e-52e0670cfd93 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:22.605661 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4e640493-0c17-4fee-988e-52e0670cfd93 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:22.606196 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4e640493-0c17-4fee-988e-52e0670cfd93 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:22.606950 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4e640493-0c17-4fee-988e-52e0670cfd93 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:22.779840 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-4e640493-0c17-4fee-988e-52e0670cfd93 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:22.797891 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4e640493-0c17-4fee-988e-52e0670cfd93 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.215375 Sep 05 12:30:22.798998 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 83/170] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:22 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:23.823477 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-46b11064-fdc8-4759-b291-cdb180ca1886 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:23.824814 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-46b11064-fdc8-4759-b291-cdb180ca1886 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:23.837529 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-46b11064-fdc8-4759-b291-cdb180ca1886 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:23.838107 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-46b11064-fdc8-4759-b291-cdb180ca1886 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:23.838711 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-46b11064-fdc8-4759-b291-cdb180ca1886 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:23.839429 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-46b11064-fdc8-4759-b291-cdb180ca1886 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:23.839940 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-46b11064-fdc8-4759-b291-cdb180ca1886 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:23.840354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-46b11064-fdc8-4759-b291-cdb180ca1886 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:23.913054 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8b0bf990-cab1-4573-9d5a-5d8798b2e728 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:23.914168 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-8b0bf990-cab1-4573-9d5a-5d8798b2e728 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:23.921441 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8b0bf990-cab1-4573-9d5a-5d8798b2e728 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:23.922243 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8b0bf990-cab1-4573-9d5a-5d8798b2e728 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:23.922842 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8b0bf990-cab1-4573-9d5a-5d8798b2e728 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:23.923624 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8b0bf990-cab1-4573-9d5a-5d8798b2e728 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:23.924227 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8b0bf990-cab1-4573-9d5a-5d8798b2e728 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:23.924846 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8b0bf990-cab1-4573-9d5a-5d8798b2e728 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:23.961996 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-8b0bf990-cab1-4573-9d5a-5d8798b2e728 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Going to try to terminate instance {{(pid=121211) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:30:24.089158 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-46b11064-fdc8-4759-b291-cdb180ca1886 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:24.101605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-46b11064-fdc8-4759-b291-cdb180ca1886 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.282394 Sep 05 12:30:24.116263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 88/171] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:23 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:24.414964 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-8b0bf990-cab1-4573-9d5a-5d8798b2e728 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 204 len: 0 microversion: 2.1 time: 0.505821 Sep 05 12:30:24.417144 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 84/172] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:30:23 2022] DELETE /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 05 12:30:24.425113 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-8c6fec41-4970-401a-83cb-dd1a49caeefc tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:24.426043 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-8c6fec41-4970-401a-83cb-dd1a49caeefc tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:24.433789 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c6fec41-4970-401a-83cb-dd1a49caeefc tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:24.434271 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c6fec41-4970-401a-83cb-dd1a49caeefc tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:24.434698 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c6fec41-4970-401a-83cb-dd1a49caeefc tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:24.435387 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c6fec41-4970-401a-83cb-dd1a49caeefc tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:24.435859 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c6fec41-4970-401a-83cb-dd1a49caeefc tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:24.436471 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c6fec41-4970-401a-83cb-dd1a49caeefc tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:24.595020 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-8c6fec41-4970-401a-83cb-dd1a49caeefc tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:24.611664 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-8c6fec41-4970-401a-83cb-dd1a49caeefc tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1554 microversion: 2.1 time: 0.187844 Sep 05 12:30:24.613720 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 89/173] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:24 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:25.140484 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-6a7862e4-b103-4d0f-9dab-046116ae986e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:25.140484 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-6a7862e4-b103-4d0f-9dab-046116ae986e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:25.153950 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6a7862e4-b103-4d0f-9dab-046116ae986e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:25.153950 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6a7862e4-b103-4d0f-9dab-046116ae986e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:25.153950 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6a7862e4-b103-4d0f-9dab-046116ae986e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:25.153950 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6a7862e4-b103-4d0f-9dab-046116ae986e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:25.154469 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6a7862e4-b103-4d0f-9dab-046116ae986e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:25.154469 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6a7862e4-b103-4d0f-9dab-046116ae986e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:25.311466 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6a7862e4-b103-4d0f-9dab-046116ae986e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:25.320742 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-6a7862e4-b103-4d0f-9dab-046116ae986e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.187031 Sep 05 12:30:25.321363 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 85/174] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:25 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:25.638389 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-397d7e44-3ee3-45cf-a1fd-8e04482e7848 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:25.639168 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-397d7e44-3ee3-45cf-a1fd-8e04482e7848 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:25.646725 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-397d7e44-3ee3-45cf-a1fd-8e04482e7848 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:25.647205 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-397d7e44-3ee3-45cf-a1fd-8e04482e7848 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:25.647658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-397d7e44-3ee3-45cf-a1fd-8e04482e7848 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:25.648373 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-397d7e44-3ee3-45cf-a1fd-8e04482e7848 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:25.648822 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-397d7e44-3ee3-45cf-a1fd-8e04482e7848 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:25.649228 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-397d7e44-3ee3-45cf-a1fd-8e04482e7848 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:25.822677 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-397d7e44-3ee3-45cf-a1fd-8e04482e7848 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:25.831106 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-397d7e44-3ee3-45cf-a1fd-8e04482e7848 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1554 microversion: 2.1 time: 0.197000 Sep 05 12:30:25.831918 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 90/175] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:25 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1554 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:26.345454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f064d754-6fbb-4d85-aea8-e3dd65025600 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:26.346146 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f064d754-6fbb-4d85-aea8-e3dd65025600 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:26.353140 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f064d754-6fbb-4d85-aea8-e3dd65025600 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:26.353726 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f064d754-6fbb-4d85-aea8-e3dd65025600 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:26.354572 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f064d754-6fbb-4d85-aea8-e3dd65025600 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:26.355056 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f064d754-6fbb-4d85-aea8-e3dd65025600 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:26.355606 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f064d754-6fbb-4d85-aea8-e3dd65025600 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:26.356488 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f064d754-6fbb-4d85-aea8-e3dd65025600 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:26.517297 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f064d754-6fbb-4d85-aea8-e3dd65025600 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:26.529969 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f064d754-6fbb-4d85-aea8-e3dd65025600 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.188134 Sep 05 12:30:26.532060 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 86/176] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:26 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:26.857937 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-9b5e9c16-a520-44eb-b5a9-bbad06f148e2 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:26.859603 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-9b5e9c16-a520-44eb-b5a9-bbad06f148e2 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:26.868302 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9b5e9c16-a520-44eb-b5a9-bbad06f148e2 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:26.872676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9b5e9c16-a520-44eb-b5a9-bbad06f148e2 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:26.872676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9b5e9c16-a520-44eb-b5a9-bbad06f148e2 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:26.872676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9b5e9c16-a520-44eb-b5a9-bbad06f148e2 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:26.872676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9b5e9c16-a520-44eb-b5a9-bbad06f148e2 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:26.873244 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9b5e9c16-a520-44eb-b5a9-bbad06f148e2 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:27.183312 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-9b5e9c16-a520-44eb-b5a9-bbad06f148e2 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:27.214138 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-9b5e9c16-a520-44eb-b5a9-bbad06f148e2 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1554 microversion: 2.1 time: 0.360468 Sep 05 12:30:27.214737 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 91/177] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:26 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1554 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:27.554685 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-240cf1e1-ea96-464a-ba87-921f7da8bcf8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:27.557335 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-240cf1e1-ea96-464a-ba87-921f7da8bcf8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:27.561890 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-240cf1e1-ea96-464a-ba87-921f7da8bcf8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:27.562380 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-240cf1e1-ea96-464a-ba87-921f7da8bcf8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:27.562873 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-240cf1e1-ea96-464a-ba87-921f7da8bcf8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:27.563643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-240cf1e1-ea96-464a-ba87-921f7da8bcf8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:27.564127 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-240cf1e1-ea96-464a-ba87-921f7da8bcf8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:27.564554 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-240cf1e1-ea96-464a-ba87-921f7da8bcf8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:27.745325 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-98f18423-54f2-4aca-8b3c-5699ee491856 req-c8ec1446-fcfc-43b6-871a-589a0ee901d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79b6762-27f0-4044-bed9-bd1f6d1ba687", "name": "network-vif-deleted", "tag": "cd04259f-c361-432d-b45e-05d24550b093"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:30:27.760595 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-98f18423-54f2-4aca-8b3c-5699ee491856 req-c8ec1446-fcfc-43b6-871a-589a0ee901d1 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:27.760991 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-98f18423-54f2-4aca-8b3c-5699ee491856 req-c8ec1446-fcfc-43b6-871a-589a0ee901d1 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:27.761514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-98f18423-54f2-4aca-8b3c-5699ee491856 req-c8ec1446-fcfc-43b6-871a-589a0ee901d1 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:27.775977 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-98f18423-54f2-4aca-8b3c-5699ee491856 req-c8ec1446-fcfc-43b6-871a-589a0ee901d1 service nova] Creating event network-vif-deleted:cd04259f-c361-432d-b45e-05d24550b093 for instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 on hv-cinder-80135 Sep 05 12:30:27.782400 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-98f18423-54f2-4aca-8b3c-5699ee491856 req-c8ec1446-fcfc-43b6-871a-589a0ee901d1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041048 Sep 05 12:30:27.784553 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 92/178] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:30:28.068707 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-240cf1e1-ea96-464a-ba87-921f7da8bcf8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:28.077164 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-240cf1e1-ea96-464a-ba87-921f7da8bcf8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.526542 Sep 05 12:30:28.077725 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 87/179] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:27 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:28.242733 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-c3302068-5e67-4ecf-8b04-d0391dd25b9d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:28.243453 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-c3302068-5e67-4ecf-8b04-d0391dd25b9d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:28.249885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c3302068-5e67-4ecf-8b04-d0391dd25b9d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:28.250363 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c3302068-5e67-4ecf-8b04-d0391dd25b9d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:28.250782 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c3302068-5e67-4ecf-8b04-d0391dd25b9d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:28.252067 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c3302068-5e67-4ecf-8b04-d0391dd25b9d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:28.252514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c3302068-5e67-4ecf-8b04-d0391dd25b9d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:28.252955 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c3302068-5e67-4ecf-8b04-d0391dd25b9d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:28.316859 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c3302068-5e67-4ecf-8b04-d0391dd25b9d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:28.325885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-c3302068-5e67-4ecf-8b04-d0391dd25b9d tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1346 microversion: 2.1 time: 0.087919 Sep 05 12:30:28.326450 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 93/180] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:28 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:29.100292 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-2b6a50ba-51e0-475d-9fb5-b62b3b8958ad tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:29.101691 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-2b6a50ba-51e0-475d-9fb5-b62b3b8958ad tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:29.115015 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2b6a50ba-51e0-475d-9fb5-b62b3b8958ad tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:29.115015 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2b6a50ba-51e0-475d-9fb5-b62b3b8958ad tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:29.115015 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2b6a50ba-51e0-475d-9fb5-b62b3b8958ad tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:29.115015 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2b6a50ba-51e0-475d-9fb5-b62b3b8958ad tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:29.115711 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2b6a50ba-51e0-475d-9fb5-b62b3b8958ad tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:29.115711 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2b6a50ba-51e0-475d-9fb5-b62b3b8958ad tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:29.251942 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-2b6a50ba-51e0-475d-9fb5-b62b3b8958ad tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:29.260217 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-2b6a50ba-51e0-475d-9fb5-b62b3b8958ad tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.163900 Sep 05 12:30:29.260771 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 88/181] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:29 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:29.349241 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-93070db4-114d-4d7c-98f3-86b835f65d48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:29.353420 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-93070db4-114d-4d7c-98f3-86b835f65d48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:29.356402 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-93070db4-114d-4d7c-98f3-86b835f65d48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:29.356940 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-93070db4-114d-4d7c-98f3-86b835f65d48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:29.357302 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-93070db4-114d-4d7c-98f3-86b835f65d48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:29.357992 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-93070db4-114d-4d7c-98f3-86b835f65d48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:29.358446 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-93070db4-114d-4d7c-98f3-86b835f65d48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:29.358864 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-93070db4-114d-4d7c-98f3-86b835f65d48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:29.395823 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-93070db4-114d-4d7c-98f3-86b835f65d48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:29.396300 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-93070db4-114d-4d7c-98f3-86b835f65d48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:29.396728 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-93070db4-114d-4d7c-98f3-86b835f65d48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:29.397364 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-93070db4-114d-4d7c-98f3-86b835f65d48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lazy-loading 'fault' on Instance uuid e79b6762-27f0-4044-bed9-bd1f6d1ba687 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:30:29.449527 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-93070db4-114d-4d7c-98f3-86b835f65d48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f976789f894296a86b4cf651fdc3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19911e0c0b444897b621ce06dbd8296a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:29.459373 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-93070db4-114d-4d7c-98f3-86b835f65d48 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 200 len: 1351 microversion: 2.1 time: 0.113975 Sep 05 12:30:29.460160 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 94/182] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:29 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 1351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:30.295578 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7c272037-3b77-4e0b-aa39-ddcf2d431366 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:30.296710 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-7c272037-3b77-4e0b-aa39-ddcf2d431366 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:30.304585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7c272037-3b77-4e0b-aa39-ddcf2d431366 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:30.310372 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7c272037-3b77-4e0b-aa39-ddcf2d431366 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:30.310372 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7c272037-3b77-4e0b-aa39-ddcf2d431366 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:30.310372 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7c272037-3b77-4e0b-aa39-ddcf2d431366 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:30.310372 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7c272037-3b77-4e0b-aa39-ddcf2d431366 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:30.310841 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7c272037-3b77-4e0b-aa39-ddcf2d431366 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:30.497699 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-7c272037-3b77-4e0b-aa39-ddcf2d431366 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:30.502027 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:30.505143 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-87ba7c4f-22c3-47cd-8aad-53cf41b7230c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:30.505836 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-87ba7c4f-22c3-47cd-8aad-53cf41b7230c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:30.507462 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-7c272037-3b77-4e0b-aa39-ddcf2d431366 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.217129 Sep 05 12:30:30.508065 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 89/183] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:30 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:30.511901 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-87ba7c4f-22c3-47cd-8aad-53cf41b7230c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:30.512401 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-87ba7c4f-22c3-47cd-8aad-53cf41b7230c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:30.512963 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-87ba7c4f-22c3-47cd-8aad-53cf41b7230c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:30.513653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-87ba7c4f-22c3-47cd-8aad-53cf41b7230c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:30.514101 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-87ba7c4f-22c3-47cd-8aad-53cf41b7230c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:30.514515 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-87ba7c4f-22c3-47cd-8aad-53cf41b7230c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:30.528541 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-87ba7c4f-22c3-47cd-8aad-53cf41b7230c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] HTTP exception thrown: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. Sep 05 12:30:30.540609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-87ba7c4f-22c3-47cd-8aad-53cf41b7230c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Request method failure captured: Sep 05 12:30:30.540609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 HTTP/1.1 Sep 05 12:30:30.540609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:30:30.540609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:30:30.540609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:30:30.540609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:30:30.540609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:30:30.540609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:30:30.540609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:30:30.540609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:30:30.540609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFeulJpz92OADyZtMqp8Im-SIzYhXsSFA_rR1YKjbq_Vm7Y4SjIxgKC6UIlBStbIGpI1hhUmKU24OW7dD05CgASqjolYt4q-ey6uBGxMG-JzH91_IH_ohqYBcZyW_kRN6wPpLJ9o9hDDrSfRSJ4eEASFaoMKJ56UKtRmmlwJ6CMJyWEQ Sep 05 12:30:30.540609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:30:30.540609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:30:30.540609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:30:30.540609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:30:30.540609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:30:30.540609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:30:30.540609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 19911e0c0b444897b621ce06dbd8296a Sep 05 12:30:30.540609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-DeleteServersTestJSON-1418866235 Sep 05 12:30:30.540609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:30:30.540609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:30:30.542261 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/19911e0c0b444897b621ce06dbd8296a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/19911e0c0b444897b621ce06dbd8296a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/19911e0c0b444897b621ce06dbd8296a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_19911e0c0b444897b621ce06dbd8296a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:30:30.542261 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-DeleteServersTestJSON-1418866235 Sep 05 12:30:30.542261 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 19911e0c0b444897b621ce06dbd8296a Sep 05 12:30:30.542261 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-DeleteServersTestJSON-1418866235 Sep 05 12:30:30.542261 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-DeleteServersTestJSON-1418866235-project Sep 05 12:30:30.542261 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:30:30.542261 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:30:30.542261 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: 69f976789f894296a86b4cf651fdc3ae Sep 05 12:30:30.542261 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-DeleteServersTestJSON-1418866235-project Sep 05 12:30:30.542261 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:30:30.542261 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. Sep 05 12:30:30.542261 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': 'e79b6762-27f0-4044-bed9-bd1f6d1ba687'} Sep 05 12:30:30.543103 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:30:30.543103 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:30.543103 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:30:30.543103 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:30:30.543103 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:30:30.543103 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:30:30.543103 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:30:30.543103 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:30:30.543103 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:30:30.543103 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:30:30.543103 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. Sep 05 12:30:30.543103 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:30:30.543103 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:30.543103 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:30:30.543103 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:30.543103 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:30.543103 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:30.543103 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:30:30.543103 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:30:30.543103 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:30:30.544326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:30:30.544326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:30:30.544326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:30:30.544326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:30:30.544326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:30:30.544326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:30:30.544326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:30:30.544326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. Sep 05 12:30:30.544326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:30:30.544326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:30.544326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:30:30.544326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:30.544326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:30.544326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:30.544326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:30:30.544326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:30:30.544326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. Sep 05 12:30:30.544326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:30:30.545320 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-87ba7c4f-22c3-47cd-8aad-53cf41b7230c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Returning 404 to user: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:30:30.545320 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-87ba7c4f-22c3-47cd-8aad-53cf41b7230c tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 404 len: 111 microversion: 2.1 time: 0.041640 Sep 05 12:30:30.545320 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 95/184] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:30 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:30:30.871798 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ce483ae2-9deb-451e-ba63-5f6ebf1bafd8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:30.875224 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ce483ae2-9deb-451e-ba63-5f6ebf1bafd8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:30.880931 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ce483ae2-9deb-451e-ba63-5f6ebf1bafd8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:30.881492 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ce483ae2-9deb-451e-ba63-5f6ebf1bafd8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:30.881942 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ce483ae2-9deb-451e-ba63-5f6ebf1bafd8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:30.882526 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ce483ae2-9deb-451e-ba63-5f6ebf1bafd8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:30.883138 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ce483ae2-9deb-451e-ba63-5f6ebf1bafd8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:30.883662 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ce483ae2-9deb-451e-ba63-5f6ebf1bafd8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:30.899809 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-ce483ae2-9deb-451e-ba63-5f6ebf1bafd8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] HTTP exception thrown: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. Sep 05 12:30:30.918388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ce483ae2-9deb-451e-ba63-5f6ebf1bafd8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Request method failure captured: Sep 05 12:30:30.918388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687/os-volume_attachments HTTP/1.1 Sep 05 12:30:30.918388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:30:30.918388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:30:30.918388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:30:30.918388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:30:30.918388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:30:30.918388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:30:30.918388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:30:30.918388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:30:30.918388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFeulJpz92OADyZtMqp8Im-SIzYhXsSFA_rR1YKjbq_Vm7Y4SjIxgKC6UIlBStbIGpI1hhUmKU24OW7dD05CgASqjolYt4q-ey6uBGxMG-JzH91_IH_ohqYBcZyW_kRN6wPpLJ9o9hDDrSfRSJ4eEASFaoMKJ56UKtRmmlwJ6CMJyWEQ Sep 05 12:30:30.918388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:30:30.918388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:30:30.918388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:30:30.918388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:30:30.918388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:30:30.918388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:30:30.918388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 19911e0c0b444897b621ce06dbd8296a Sep 05 12:30:30.918388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-DeleteServersTestJSON-1418866235 Sep 05 12:30:30.918388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:30:30.918388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:30:30.919803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/19911e0c0b444897b621ce06dbd8296a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/19911e0c0b444897b621ce06dbd8296a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/19911e0c0b444897b621ce06dbd8296a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_19911e0c0b444897b621ce06dbd8296a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:30:30.919803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-DeleteServersTestJSON-1418866235 Sep 05 12:30:30.919803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 19911e0c0b444897b621ce06dbd8296a Sep 05 12:30:30.919803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-DeleteServersTestJSON-1418866235 Sep 05 12:30:30.919803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-DeleteServersTestJSON-1418866235-project Sep 05 12:30:30.919803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:30:30.919803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:30:30.919803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: 69f976789f894296a86b4cf651fdc3ae Sep 05 12:30:30.919803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-DeleteServersTestJSON-1418866235-project Sep 05 12:30:30.919803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: > Sep 05 12:30:30.919803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. Sep 05 12:30:30.919803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'server_id': 'e79b6762-27f0-4044-bed9-bd1f6d1ba687'} Sep 05 12:30:30.920643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:30:30.920643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:30.920643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:30:30.920643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:30:30.920643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:30:30.920643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:30:30.920643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:30:30.920643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:30:30.920643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:30:30.920643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:30:30.920643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. Sep 05 12:30:30.920643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:30:30.920643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:30.920643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:30:30.920643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:30.920643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:30.920643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:30.920643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:30:30.920643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:30:30.920643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:30:30.922291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:30:30.922291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 05 12:30:30.922291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:30:30.922291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 05 12:30:30.922291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:30:30.922291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 05 12:30:30.922291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 05 12:30:30.922291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:30:30.922291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:30:30.922291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. Sep 05 12:30:30.922291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:30:30.922291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:30.922291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:30:30.922291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:30.922291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:30.922291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:30.922291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:30:30.922291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:30:30.922291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. Sep 05 12:30:30.922291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:30:30.927470 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ce483ae2-9deb-451e-ba63-5f6ebf1bafd8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Returning 404 to user: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:30:30.927470 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ce483ae2-9deb-451e-ba63-5f6ebf1bafd8 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.052229 Sep 05 12:30:30.927470 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 90/185] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:30:30 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:30:31.531254 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-0752e69f-e300-4ef7-b22e-db43ddbbe71b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:31.540833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-0752e69f-e300-4ef7-b22e-db43ddbbe71b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:31.540833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0752e69f-e300-4ef7-b22e-db43ddbbe71b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:31.540833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0752e69f-e300-4ef7-b22e-db43ddbbe71b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:31.540833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0752e69f-e300-4ef7-b22e-db43ddbbe71b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:31.541270 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0752e69f-e300-4ef7-b22e-db43ddbbe71b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:31.541270 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0752e69f-e300-4ef7-b22e-db43ddbbe71b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:31.541270 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0752e69f-e300-4ef7-b22e-db43ddbbe71b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:31.679076 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-0752e69f-e300-4ef7-b22e-db43ddbbe71b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:31.687003 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-0752e69f-e300-4ef7-b22e-db43ddbbe71b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.159741 Sep 05 12:30:31.687622 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 96/186] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:31 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:31.992909 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ed76f357-fe14-4e6b-a4ef-e46c7d505057 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1247357251", "imageRef": "7844cf5b-4975-4cb9-a7f8-31cc5e52098a", "flavorRef": "452", "networks": [{"uuid": "488a601a-db3c-42c3-a1b1-31b43872e2ec"}]}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:30:32.053046 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.network.neutron [None req-ed76f357-fe14-4e6b-a4ef-e46c7d505057 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] validate_networks() for [('488a601a-db3c-42c3-a1b1-31b43872e2ec', None, None, None, None, None)] {{(pid=121211) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:30:32.416938 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e1bdd7e4-0306-473d-8380-9667e51fa857 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:32.417428 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-e1bdd7e4-0306-473d-8380-9667e51fa857 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:32.424125 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e1bdd7e4-0306-473d-8380-9667e51fa857 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:32.424606 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e1bdd7e4-0306-473d-8380-9667e51fa857 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:32.425188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e1bdd7e4-0306-473d-8380-9667e51fa857 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:32.426353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e1bdd7e4-0306-473d-8380-9667e51fa857 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:32.427394 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e1bdd7e4-0306-473d-8380-9667e51fa857 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:32.428010 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e1bdd7e4-0306-473d-8380-9667e51fa857 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:32.445512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-e1bdd7e4-0306-473d-8380-9667e51fa857 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] HTTP exception thrown: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. Sep 05 12:30:32.447059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e1bdd7e4-0306-473d-8380-9667e51fa857 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Request method failure captured: Sep 05 12:30:32.447059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: DELETE /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 HTTP/1.1 Sep 05 12:30:32.447059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:30:32.447059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:30:32.447059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:30:32.447059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:30:32.447059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:30:32.447059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:30:32.447059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:30:32.447059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:30:32.447059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFeulJpz92OADyZtMqp8Im-SIzYhXsSFA_rR1YKjbq_Vm7Y4SjIxgKC6UIlBStbIGpI1hhUmKU24OW7dD05CgASqjolYt4q-ey6uBGxMG-JzH91_IH_ohqYBcZyW_kRN6wPpLJ9o9hDDrSfRSJ4eEASFaoMKJ56UKtRmmlwJ6CMJyWEQ Sep 05 12:30:32.447059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:30:32.447059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:30:32.447059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:30:32.447059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:30:32.447059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:30:32.447059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:30:32.447059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 19911e0c0b444897b621ce06dbd8296a Sep 05 12:30:32.447059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-DeleteServersTestJSON-1418866235 Sep 05 12:30:32.447059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:30:32.447059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:30:32.448355 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/19911e0c0b444897b621ce06dbd8296a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/19911e0c0b444897b621ce06dbd8296a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/19911e0c0b444897b621ce06dbd8296a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_19911e0c0b444897b621ce06dbd8296a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:30:32.448355 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-DeleteServersTestJSON-1418866235 Sep 05 12:30:32.448355 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 19911e0c0b444897b621ce06dbd8296a Sep 05 12:30:32.448355 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-DeleteServersTestJSON-1418866235 Sep 05 12:30:32.448355 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-DeleteServersTestJSON-1418866235-project Sep 05 12:30:32.448355 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:30:32.448355 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:30:32.448355 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: 69f976789f894296a86b4cf651fdc3ae Sep 05 12:30:32.448355 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-DeleteServersTestJSON-1418866235-project Sep 05 12:30:32.448355 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:30:32.448355 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. Sep 05 12:30:32.448355 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': 'e79b6762-27f0-4044-bed9-bd1f6d1ba687'} Sep 05 12:30:32.449002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:30:32.449002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:32.449002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:30:32.449002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:30:32.449002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:30:32.449002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:30:32.449002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:30:32.449002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:30:32.449002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:30:32.449002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:30:32.449002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. Sep 05 12:30:32.449002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:30:32.449002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:32.449002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:30:32.449002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:32.449002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:32.449002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:32.449002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:30:32.449002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:30:32.449002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:30:32.450064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:30:32.450064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 12:30:32.450064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 12:30:32.450064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 12:30:32.450064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 12:30:32.450064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:30:32.450064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:30:32.450064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:30:32.450064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:30:32.450064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. Sep 05 12:30:32.450064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:30:32.450064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:32.450064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:30:32.450064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:32.450064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:32.450064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:32.450064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:30:32.450064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:30:32.450064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. Sep 05 12:30:32.450064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:30:32.451151 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e1bdd7e4-0306-473d-8380-9667e51fa857 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Returning 404 to user: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:30:32.451151 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-e1bdd7e4-0306-473d-8380-9667e51fa857 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 404 len: 111 microversion: 2.1 time: 0.035558 Sep 05 12:30:32.451151 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 97/187] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:30:32 2022] DELETE /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 05 12:30:32.457345 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-342fc039-bea3-4f73-85e4-81fb5defe811 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:32.458078 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-342fc039-bea3-4f73-85e4-81fb5defe811 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] [instance: e79b6762-27f0-4044-bed9-bd1f6d1ba687] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:32.464708 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-342fc039-bea3-4f73-85e4-81fb5defe811 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:32.470823 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-ed76f357-fe14-4e6b-a4ef-e46c7d505057 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Flavor limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:30:32.470952 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-342fc039-bea3-4f73-85e4-81fb5defe811 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:32.471056 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-ed76f357-fe14-4e6b-a4ef-e46c7d505057 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Image limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:30:32.471132 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-342fc039-bea3-4f73-85e4-81fb5defe811 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:32.471302 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-ed76f357-fe14-4e6b-a4ef-e46c7d505057 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Flavor pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:30:32.471378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-342fc039-bea3-4f73-85e4-81fb5defe811 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:32.471450 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-ed76f357-fe14-4e6b-a4ef-e46c7d505057 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Image pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:30:32.471635 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-342fc039-bea3-4f73-85e4-81fb5defe811 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:32.471744 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-ed76f357-fe14-4e6b-a4ef-e46c7d505057 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:30:32.471828 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-342fc039-bea3-4f73-85e4-81fb5defe811 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:32.479255 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ed76f357-fe14-4e6b-a4ef-e46c7d505057 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:32.479771 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ed76f357-fe14-4e6b-a4ef-e46c7d505057 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:32.480190 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ed76f357-fe14-4e6b-a4ef-e46c7d505057 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:32.480909 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ed76f357-fe14-4e6b-a4ef-e46c7d505057 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:32.481354 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ed76f357-fe14-4e6b-a4ef-e46c7d505057 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:32.481769 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ed76f357-fe14-4e6b-a4ef-e46c7d505057 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:32.484203 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-342fc039-bea3-4f73-85e4-81fb5defe811 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] HTTP exception thrown: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. Sep 05 12:30:32.485806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-342fc039-bea3-4f73-85e4-81fb5defe811 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Request method failure captured: Sep 05 12:30:32.485806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 HTTP/1.1 Sep 05 12:30:32.485806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:30:32.485806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:30:32.485806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:30:32.485806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:30:32.485806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:30:32.485806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:30:32.485806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:30:32.485806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:30:32.485806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFeulJpz92OADyZtMqp8Im-SIzYhXsSFA_rR1YKjbq_Vm7Y4SjIxgKC6UIlBStbIGpI1hhUmKU24OW7dD05CgASqjolYt4q-ey6uBGxMG-JzH91_IH_ohqYBcZyW_kRN6wPpLJ9o9hDDrSfRSJ4eEASFaoMKJ56UKtRmmlwJ6CMJyWEQ Sep 05 12:30:32.485806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:30:32.485806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:30:32.485806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:30:32.485806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:30:32.485806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:30:32.485806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:30:32.485806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 19911e0c0b444897b621ce06dbd8296a Sep 05 12:30:32.485806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-DeleteServersTestJSON-1418866235 Sep 05 12:30:32.485806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:30:32.485806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:30:32.487258 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/19911e0c0b444897b621ce06dbd8296a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/19911e0c0b444897b621ce06dbd8296a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/19911e0c0b444897b621ce06dbd8296a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_19911e0c0b444897b621ce06dbd8296a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:30:32.487258 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-DeleteServersTestJSON-1418866235 Sep 05 12:30:32.487258 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 19911e0c0b444897b621ce06dbd8296a Sep 05 12:30:32.487258 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-DeleteServersTestJSON-1418866235 Sep 05 12:30:32.487258 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-DeleteServersTestJSON-1418866235-project Sep 05 12:30:32.487258 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:30:32.487258 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:30:32.487258 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: 69f976789f894296a86b4cf651fdc3ae Sep 05 12:30:32.487258 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-DeleteServersTestJSON-1418866235-project Sep 05 12:30:32.487258 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:30:32.487258 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. Sep 05 12:30:32.487258 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': 'e79b6762-27f0-4044-bed9-bd1f6d1ba687'} Sep 05 12:30:32.488162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:30:32.488162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:32.488162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:30:32.488162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:30:32.488162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:30:32.488162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:30:32.488162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:30:32.488162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:30:32.488162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:30:32.488162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:30:32.488162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. Sep 05 12:30:32.488162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:30:32.488162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:32.488162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:30:32.488162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:32.488162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:32.488162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:32.488162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:30:32.488162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:30:32.488162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:30:32.489926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:30:32.489926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:30:32.489926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:30:32.489926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:30:32.489926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:30:32.489926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:30:32.489926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:30:32.489926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. Sep 05 12:30:32.489926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:30:32.489926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:30:32.489926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:30:32.489926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:30:32.489926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:30:32.489926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:30:32.489926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:30:32.489926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:30:32.489926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. Sep 05 12:30:32.489926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:30:32.492145 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-342fc039-bea3-4f73-85e4-81fb5defe811 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] Returning 404 to user: Instance e79b6762-27f0-4044-bed9-bd1f6d1ba687 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:30:32.492145 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-342fc039-bea3-4f73-85e4-81fb5defe811 tempest-DeleteServersTestJSON-1418866235 tempest-DeleteServersTestJSON-1418866235-project] 10.222.0.62 "GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687" status: 404 len: 111 microversion: 2.1 time: 0.034519 Sep 05 12:30:32.492145 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 98/188] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:32 2022] GET /compute/v2.1/servers/e79b6762-27f0-4044-bed9-bd1f6d1ba687 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 05 12:30:32.501368 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-ed76f357-fe14-4e6b-a4ef-e46c7d505057 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Getting quotas for project d5ecc5cd1d854b17bbe9ee678ecacfe3. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:30:32.510225 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-ed76f357-fe14-4e6b-a4ef-e46c7d505057 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Getting quotas for user a669f6cbac5a4d84a9e71c27c01969ff and project d5ecc5cd1d854b17bbe9ee678ecacfe3. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:30:32.527401 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ed76f357-fe14-4e6b-a4ef-e46c7d505057 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Going to run 1 instances... {{(pid=121211) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:30:32.529899 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ed76f357-fe14-4e6b-a4ef-e46c7d505057 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7844cf5b-4975-4cb9-a7f8-31cc5e52098a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121211) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:30:32.711350 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ed76f357-fe14-4e6b-a4ef-e46c7d505057 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721397 Sep 05 12:30:32.712250 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 91/189] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Sep 5 12:30:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:30:32.713026 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-93c9fe8b-80a3-4606-be39-8fa1278d313b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:32.713702 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-93c9fe8b-80a3-4606-be39-8fa1278d313b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:32.727888 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-93c9fe8b-80a3-4606-be39-8fa1278d313b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:32.732676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-93c9fe8b-80a3-4606-be39-8fa1278d313b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:32.732676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-93c9fe8b-80a3-4606-be39-8fa1278d313b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:32.732676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-93c9fe8b-80a3-4606-be39-8fa1278d313b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:32.732676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-93c9fe8b-80a3-4606-be39-8fa1278d313b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:32.733082 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-93c9fe8b-80a3-4606-be39-8fa1278d313b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:32.733728 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-bd32f0c0-dc53-4bd3-a526-02ff8be48b09 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:32.734505 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-bd32f0c0-dc53-4bd3-a526-02ff8be48b09 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:32.816264 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-bd32f0c0-dc53-4bd3-a526-02ff8be48b09 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:32.825279 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-bd32f0c0-dc53-4bd3-a526-02ff8be48b09 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1214 microversion: 2.1 time: 0.104098 Sep 05 12:30:32.832590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 92/190] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:32 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:30:33.077671 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-93c9fe8b-80a3-4606-be39-8fa1278d313b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:33.086240 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-93c9fe8b-80a3-4606-be39-8fa1278d313b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.378693 Sep 05 12:30:33.086967 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 99/191] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:32 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:33.858484 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0dc5eeda-1c34-4163-8ef8-3fce96562f35 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:33.859949 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0dc5eeda-1c34-4163-8ef8-3fce96562f35 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:34.004077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0dc5eeda-1c34-4163-8ef8-3fce96562f35 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:34.013771 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0dc5eeda-1c34-4163-8ef8-3fce96562f35 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1214 microversion: 2.1 time: 0.161865 Sep 05 12:30:34.015148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 93/192] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:33 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1214 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:34.120811 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-12ab4b06-1f74-46eb-9951-58aa794d6b9c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:34.121499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-12ab4b06-1f74-46eb-9951-58aa794d6b9c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:34.134312 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-12ab4b06-1f74-46eb-9951-58aa794d6b9c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:34.134891 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-12ab4b06-1f74-46eb-9951-58aa794d6b9c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:34.135323 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-12ab4b06-1f74-46eb-9951-58aa794d6b9c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:34.136281 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-12ab4b06-1f74-46eb-9951-58aa794d6b9c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:34.136746 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-12ab4b06-1f74-46eb-9951-58aa794d6b9c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:34.137170 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-12ab4b06-1f74-46eb-9951-58aa794d6b9c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:34.337451 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-12ab4b06-1f74-46eb-9951-58aa794d6b9c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:34.347974 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-12ab4b06-1f74-46eb-9951-58aa794d6b9c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.238112 Sep 05 12:30:34.348797 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 100/193] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:34 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:35.039550 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-53180fba-b1bc-43b4-a80e-87853060aee8 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:35.040197 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-53180fba-b1bc-43b4-a80e-87853060aee8 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:35.069720 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-53180fba-b1bc-43b4-a80e-87853060aee8 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:35.075434 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-53180fba-b1bc-43b4-a80e-87853060aee8 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:35.078869 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-53180fba-b1bc-43b4-a80e-87853060aee8 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:35.079921 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-53180fba-b1bc-43b4-a80e-87853060aee8 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:35.080782 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-53180fba-b1bc-43b4-a80e-87853060aee8 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:35.081431 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-53180fba-b1bc-43b4-a80e-87853060aee8 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:35.196385 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-53180fba-b1bc-43b4-a80e-87853060aee8 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:35.209865 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-53180fba-b1bc-43b4-a80e-87853060aee8 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1210 microversion: 2.1 time: 0.176341 Sep 05 12:30:35.215702 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 94/194] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:35 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1210 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:30:35.377018 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-75628ab6-f281-465d-8e5a-762f3cae2fba tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:35.382797 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-75628ab6-f281-465d-8e5a-762f3cae2fba tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:35.397674 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-75628ab6-f281-465d-8e5a-762f3cae2fba tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:35.399249 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-75628ab6-f281-465d-8e5a-762f3cae2fba tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:35.400117 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-75628ab6-f281-465d-8e5a-762f3cae2fba tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:35.400922 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-75628ab6-f281-465d-8e5a-762f3cae2fba tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:35.401370 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-75628ab6-f281-465d-8e5a-762f3cae2fba tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:35.402023 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-75628ab6-f281-465d-8e5a-762f3cae2fba tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:35.824100 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-75628ab6-f281-465d-8e5a-762f3cae2fba tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:35.837094 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-75628ab6-f281-465d-8e5a-762f3cae2fba tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.468236 Sep 05 12:30:35.837929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 101/195] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:35 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:36.253353 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d6e461dc-cfcb-4334-acaf-1d8545c4dfd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:36.253994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d6e461dc-cfcb-4334-acaf-1d8545c4dfd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:36.262421 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d6e461dc-cfcb-4334-acaf-1d8545c4dfd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:36.262914 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d6e461dc-cfcb-4334-acaf-1d8545c4dfd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:36.263348 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d6e461dc-cfcb-4334-acaf-1d8545c4dfd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:36.272193 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d6e461dc-cfcb-4334-acaf-1d8545c4dfd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:36.272992 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d6e461dc-cfcb-4334-acaf-1d8545c4dfd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:36.276546 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d6e461dc-cfcb-4334-acaf-1d8545c4dfd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:36.436390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d6e461dc-cfcb-4334-acaf-1d8545c4dfd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:36.450247 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d6e461dc-cfcb-4334-acaf-1d8545c4dfd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1266 microversion: 2.1 time: 0.208008 Sep 05 12:30:36.451521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 95/196] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:36 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:36.864572 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4354788b-3e4e-485e-9912-457b17f07dc0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:36.865371 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-4354788b-3e4e-485e-9912-457b17f07dc0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:36.874223 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4354788b-3e4e-485e-9912-457b17f07dc0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:36.874762 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4354788b-3e4e-485e-9912-457b17f07dc0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:36.877407 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4354788b-3e4e-485e-9912-457b17f07dc0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:36.878152 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4354788b-3e4e-485e-9912-457b17f07dc0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:36.878616 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4354788b-3e4e-485e-9912-457b17f07dc0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:36.879046 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4354788b-3e4e-485e-9912-457b17f07dc0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:37.190241 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-4354788b-3e4e-485e-9912-457b17f07dc0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:37.202919 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-4354788b-3e4e-485e-9912-457b17f07dc0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.342416 Sep 05 12:30:37.203526 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 102/197] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:36 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:30:37.480520 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4c86917a-6510-4596-b95a-92f47c0c5506 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:37.487782 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4c86917a-6510-4596-b95a-92f47c0c5506 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:37.496967 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4c86917a-6510-4596-b95a-92f47c0c5506 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:37.507492 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4c86917a-6510-4596-b95a-92f47c0c5506 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:37.509834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4c86917a-6510-4596-b95a-92f47c0c5506 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:37.511766 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4c86917a-6510-4596-b95a-92f47c0c5506 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:37.515113 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4c86917a-6510-4596-b95a-92f47c0c5506 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:37.516163 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4c86917a-6510-4596-b95a-92f47c0c5506 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:37.782407 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-4c86917a-6510-4596-b95a-92f47c0c5506 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:37.803200 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4c86917a-6510-4596-b95a-92f47c0c5506 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1272 microversion: 2.1 time: 0.331750 Sep 05 12:30:37.807205 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 96/198] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:37 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1272 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:38.229415 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-5d17b233-c489-418c-a682-7322a8eb458a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:38.230594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-5d17b233-c489-418c-a682-7322a8eb458a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:38.246613 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5d17b233-c489-418c-a682-7322a8eb458a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:38.247124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5d17b233-c489-418c-a682-7322a8eb458a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:38.253713 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5d17b233-c489-418c-a682-7322a8eb458a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:38.254509 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5d17b233-c489-418c-a682-7322a8eb458a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:38.255588 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5d17b233-c489-418c-a682-7322a8eb458a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:38.271713 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5d17b233-c489-418c-a682-7322a8eb458a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:38.490622 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-5d17b233-c489-418c-a682-7322a8eb458a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:38.502800 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-5d17b233-c489-418c-a682-7322a8eb458a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.278228 Sep 05 12:30:38.509573 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 103/199] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:38 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:38.833513 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-db2be8a4-e707-44fc-a80f-8a2f4965c1fe tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:38.837175 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-db2be8a4-e707-44fc-a80f-8a2f4965c1fe tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:38.845691 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-db2be8a4-e707-44fc-a80f-8a2f4965c1fe tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:38.846494 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-db2be8a4-e707-44fc-a80f-8a2f4965c1fe tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:38.849099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-db2be8a4-e707-44fc-a80f-8a2f4965c1fe tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:38.851433 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-db2be8a4-e707-44fc-a80f-8a2f4965c1fe tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:38.852196 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-db2be8a4-e707-44fc-a80f-8a2f4965c1fe tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:38.852795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-db2be8a4-e707-44fc-a80f-8a2f4965c1fe tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:39.177338 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-db2be8a4-e707-44fc-a80f-8a2f4965c1fe tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:39.186948 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-db2be8a4-e707-44fc-a80f-8a2f4965c1fe tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1314 microversion: 2.1 time: 0.362027 Sep 05 12:30:39.187522 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 97/200] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:38 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:39.542964 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-29d82d1c-42aa-4b66-9d39-3fe7e86215f7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:39.543833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-29d82d1c-42aa-4b66-9d39-3fe7e86215f7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:39.559493 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-29d82d1c-42aa-4b66-9d39-3fe7e86215f7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:39.560018 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-29d82d1c-42aa-4b66-9d39-3fe7e86215f7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:39.560438 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-29d82d1c-42aa-4b66-9d39-3fe7e86215f7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:39.561158 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-29d82d1c-42aa-4b66-9d39-3fe7e86215f7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:39.568684 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-29d82d1c-42aa-4b66-9d39-3fe7e86215f7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:39.569182 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-29d82d1c-42aa-4b66-9d39-3fe7e86215f7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:39.685355 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-1a584b89-07bf-4f7e-822a-90ca3c89b1bc req-3f2e6cf5-771d-4366-b2b5-218a4b36f6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce1638f-9b04-4059-b2a6-633ebebbd3f6", "tag": "267484d6-bfdb-4495-a3ee-3e265d40b68e"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:30:39.698026 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-1a584b89-07bf-4f7e-822a-90ca3c89b1bc req-3f2e6cf5-771d-4366-b2b5-218a4b36f6e9 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:39.698594 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-1a584b89-07bf-4f7e-822a-90ca3c89b1bc req-3f2e6cf5-771d-4366-b2b5-218a4b36f6e9 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:39.699102 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-1a584b89-07bf-4f7e-822a-90ca3c89b1bc req-3f2e6cf5-771d-4366-b2b5-218a4b36f6e9 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:39.721287 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-1a584b89-07bf-4f7e-822a-90ca3c89b1bc req-3f2e6cf5-771d-4366-b2b5-218a4b36f6e9 service nova] Creating event network-changed:267484d6-bfdb-4495-a3ee-3e265d40b68e for instance fce1638f-9b04-4059-b2a6-633ebebbd3f6 on hv-cinder-80135 Sep 05 12:30:39.733811 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-1a584b89-07bf-4f7e-822a-90ca3c89b1bc req-3f2e6cf5-771d-4366-b2b5-218a4b36f6e9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049970 Sep 05 12:30:39.750499 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 98/201] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:30:39.806055 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-29d82d1c-42aa-4b66-9d39-3fe7e86215f7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:39.815399 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-29d82d1c-42aa-4b66-9d39-3fe7e86215f7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.280132 Sep 05 12:30:39.815963 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 104/202] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:39 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:40.211182 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ebb32a08-2ff2-4169-a5b7-2d5d1217f4bf tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:40.212098 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ebb32a08-2ff2-4169-a5b7-2d5d1217f4bf tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:40.220012 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ebb32a08-2ff2-4169-a5b7-2d5d1217f4bf tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:40.220639 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ebb32a08-2ff2-4169-a5b7-2d5d1217f4bf tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:40.221080 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ebb32a08-2ff2-4169-a5b7-2d5d1217f4bf tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:40.221810 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ebb32a08-2ff2-4169-a5b7-2d5d1217f4bf tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:40.222267 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ebb32a08-2ff2-4169-a5b7-2d5d1217f4bf tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:40.222699 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ebb32a08-2ff2-4169-a5b7-2d5d1217f4bf tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:40.405393 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ebb32a08-2ff2-4169-a5b7-2d5d1217f4bf tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:40.416624 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ebb32a08-2ff2-4169-a5b7-2d5d1217f4bf tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1314 microversion: 2.1 time: 0.210660 Sep 05 12:30:40.417768 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 99/203] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:40 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:40.841255 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e398275c-14c9-40ba-924e-a68a63349295 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:40.842459 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-e398275c-14c9-40ba-924e-a68a63349295 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:40.849229 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e398275c-14c9-40ba-924e-a68a63349295 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:40.849938 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e398275c-14c9-40ba-924e-a68a63349295 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:40.850560 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e398275c-14c9-40ba-924e-a68a63349295 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:40.851366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e398275c-14c9-40ba-924e-a68a63349295 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:40.851821 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e398275c-14c9-40ba-924e-a68a63349295 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:40.856629 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e398275c-14c9-40ba-924e-a68a63349295 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:41.005964 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-e398275c-14c9-40ba-924e-a68a63349295 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:41.018896 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-e398275c-14c9-40ba-924e-a68a63349295 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.182537 Sep 05 12:30:41.019486 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 105/204] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:40 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:41.441217 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ebd70ab0-e325-4266-940a-c404ad5bcd6e tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:41.443746 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ebd70ab0-e325-4266-940a-c404ad5bcd6e tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:41.456407 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ebd70ab0-e325-4266-940a-c404ad5bcd6e tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:41.457286 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ebd70ab0-e325-4266-940a-c404ad5bcd6e tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:41.458263 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ebd70ab0-e325-4266-940a-c404ad5bcd6e tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:41.459045 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ebd70ab0-e325-4266-940a-c404ad5bcd6e tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:41.459853 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ebd70ab0-e325-4266-940a-c404ad5bcd6e tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:41.460417 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ebd70ab0-e325-4266-940a-c404ad5bcd6e tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:41.630431 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ebd70ab0-e325-4266-940a-c404ad5bcd6e tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:41.642340 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ebd70ab0-e325-4266-940a-c404ad5bcd6e tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1314 microversion: 2.1 time: 0.204978 Sep 05 12:30:41.643444 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 100/205] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:41 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:42.044862 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-b18a5156-80a7-4820-8a4a-4c971008c095 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:42.045552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-b18a5156-80a7-4820-8a4a-4c971008c095 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:42.053082 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b18a5156-80a7-4820-8a4a-4c971008c095 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:42.055479 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b18a5156-80a7-4820-8a4a-4c971008c095 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:42.055479 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b18a5156-80a7-4820-8a4a-4c971008c095 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:42.055479 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b18a5156-80a7-4820-8a4a-4c971008c095 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:42.055479 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b18a5156-80a7-4820-8a4a-4c971008c095 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:42.056370 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b18a5156-80a7-4820-8a4a-4c971008c095 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:42.080253 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=100 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:42.627384 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-b18a5156-80a7-4820-8a4a-4c971008c095 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:42.636277 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-b18a5156-80a7-4820-8a4a-4c971008c095 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.596783 Sep 05 12:30:42.656132 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 106/206] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:42 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:42.668653 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d10cabc9-c390-49a5-bb31-dcf0bdadb169 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:42.670418 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d10cabc9-c390-49a5-bb31-dcf0bdadb169 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:42.676731 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=2 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:42.681326 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d10cabc9-c390-49a5-bb31-dcf0bdadb169 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:42.682105 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d10cabc9-c390-49a5-bb31-dcf0bdadb169 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:42.682867 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d10cabc9-c390-49a5-bb31-dcf0bdadb169 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:42.683794 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d10cabc9-c390-49a5-bb31-dcf0bdadb169 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:42.684603 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d10cabc9-c390-49a5-bb31-dcf0bdadb169 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:42.685179 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d10cabc9-c390-49a5-bb31-dcf0bdadb169 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:42.883524 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d10cabc9-c390-49a5-bb31-dcf0bdadb169 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:42.893864 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d10cabc9-c390-49a5-bb31-dcf0bdadb169 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1314 microversion: 2.1 time: 0.231114 Sep 05 12:30:42.894903 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 101/207] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:42 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:43.669076 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-6331c743-c854-4b06-b1a1-db27fadae94d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:43.669076 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-6331c743-c854-4b06-b1a1-db27fadae94d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:43.671283 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6331c743-c854-4b06-b1a1-db27fadae94d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:43.675934 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6331c743-c854-4b06-b1a1-db27fadae94d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:43.675934 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6331c743-c854-4b06-b1a1-db27fadae94d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:43.675934 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6331c743-c854-4b06-b1a1-db27fadae94d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:43.675934 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6331c743-c854-4b06-b1a1-db27fadae94d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:43.676472 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6331c743-c854-4b06-b1a1-db27fadae94d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:43.814267 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6331c743-c854-4b06-b1a1-db27fadae94d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:43.823417 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-6331c743-c854-4b06-b1a1-db27fadae94d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.164232 Sep 05 12:30:43.824248 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 107/208] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:43 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:43.925220 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-19a96107-c27d-4ae9-ba21-68429bc7126a tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:43.926733 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-19a96107-c27d-4ae9-ba21-68429bc7126a tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:43.944069 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-19a96107-c27d-4ae9-ba21-68429bc7126a tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:43.945287 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-19a96107-c27d-4ae9-ba21-68429bc7126a tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:43.945941 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-19a96107-c27d-4ae9-ba21-68429bc7126a tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:43.947251 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-19a96107-c27d-4ae9-ba21-68429bc7126a tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:43.948512 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-19a96107-c27d-4ae9-ba21-68429bc7126a tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:43.949181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-19a96107-c27d-4ae9-ba21-68429bc7126a tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:44.013551 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=10 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:44.125263 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-19a96107-c27d-4ae9-ba21-68429bc7126a tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:44.135879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-19a96107-c27d-4ae9-ba21-68429bc7126a tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1314 microversion: 2.1 time: 0.214827 Sep 05 12:30:44.137029 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 102/209] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:43 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:44.851773 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-79664631-51e0-4d14-a4da-981fbe38b97f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:44.852457 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-79664631-51e0-4d14-a4da-981fbe38b97f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:44.862395 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-79664631-51e0-4d14-a4da-981fbe38b97f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:44.862901 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-79664631-51e0-4d14-a4da-981fbe38b97f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:44.863514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-79664631-51e0-4d14-a4da-981fbe38b97f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:44.864260 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-79664631-51e0-4d14-a4da-981fbe38b97f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:44.864716 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-79664631-51e0-4d14-a4da-981fbe38b97f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:44.865136 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-79664631-51e0-4d14-a4da-981fbe38b97f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:45.019624 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-79664631-51e0-4d14-a4da-981fbe38b97f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:45.029678 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-79664631-51e0-4d14-a4da-981fbe38b97f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.184355 Sep 05 12:30:45.041977 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 108/210] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:44 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:45.162232 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-337034df-5c73-47ca-8938-0445b730cc8f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:45.163876 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-337034df-5c73-47ca-8938-0445b730cc8f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:45.171276 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:45.173391 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-337034df-5c73-47ca-8938-0445b730cc8f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:45.173936 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-337034df-5c73-47ca-8938-0445b730cc8f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:45.174387 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-337034df-5c73-47ca-8938-0445b730cc8f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:45.175079 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-337034df-5c73-47ca-8938-0445b730cc8f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:45.176824 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-337034df-5c73-47ca-8938-0445b730cc8f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:45.177408 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-337034df-5c73-47ca-8938-0445b730cc8f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:45.328818 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-337034df-5c73-47ca-8938-0445b730cc8f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:45.340344 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-337034df-5c73-47ca-8938-0445b730cc8f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1314 microversion: 2.1 time: 0.184699 Sep 05 12:30:45.341426 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 103/211] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:45 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:46.061780 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-af94c88f-e523-4ec4-88a7-c69e20697310 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:46.062414 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-af94c88f-e523-4ec4-88a7-c69e20697310 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:46.070711 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-af94c88f-e523-4ec4-88a7-c69e20697310 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:46.071384 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-af94c88f-e523-4ec4-88a7-c69e20697310 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:46.071869 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-af94c88f-e523-4ec4-88a7-c69e20697310 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:46.076069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-af94c88f-e523-4ec4-88a7-c69e20697310 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:46.076069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-af94c88f-e523-4ec4-88a7-c69e20697310 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:46.076069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-af94c88f-e523-4ec4-88a7-c69e20697310 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:46.225271 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-af94c88f-e523-4ec4-88a7-c69e20697310 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:46.234949 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-af94c88f-e523-4ec4-88a7-c69e20697310 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.179959 Sep 05 12:30:46.235959 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 109/212] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:46 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:46.362889 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4ad66e5c-3d05-4709-8baa-76e840ad4e08 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:46.363501 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4ad66e5c-3d05-4709-8baa-76e840ad4e08 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:46.371644 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ad66e5c-3d05-4709-8baa-76e840ad4e08 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:46.375696 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ad66e5c-3d05-4709-8baa-76e840ad4e08 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:46.375696 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ad66e5c-3d05-4709-8baa-76e840ad4e08 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:46.375696 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ad66e5c-3d05-4709-8baa-76e840ad4e08 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:46.375696 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ad66e5c-3d05-4709-8baa-76e840ad4e08 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:46.376189 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ad66e5c-3d05-4709-8baa-76e840ad4e08 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:46.515174 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-4ad66e5c-3d05-4709-8baa-76e840ad4e08 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:46.523927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4ad66e5c-3d05-4709-8baa-76e840ad4e08 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1314 microversion: 2.1 time: 0.164671 Sep 05 12:30:46.524765 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 104/213] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:46 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:47.258512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d05bf7d8-068e-4ac1-9bea-395352545b28 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:47.259041 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d05bf7d8-068e-4ac1-9bea-395352545b28 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:47.265787 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d05bf7d8-068e-4ac1-9bea-395352545b28 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:47.266273 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d05bf7d8-068e-4ac1-9bea-395352545b28 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:47.266701 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d05bf7d8-068e-4ac1-9bea-395352545b28 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:47.267489 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d05bf7d8-068e-4ac1-9bea-395352545b28 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:47.267984 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d05bf7d8-068e-4ac1-9bea-395352545b28 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:47.268397 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d05bf7d8-068e-4ac1-9bea-395352545b28 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:47.422663 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d05bf7d8-068e-4ac1-9bea-395352545b28 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:47.443946 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d05bf7d8-068e-4ac1-9bea-395352545b28 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.189872 Sep 05 12:30:47.444660 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 110/214] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:47 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:47.546853 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-cf702da9-80be-4be2-802f-20af5361054d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:47.547453 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-cf702da9-80be-4be2-802f-20af5361054d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:47.557151 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cf702da9-80be-4be2-802f-20af5361054d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:47.557660 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cf702da9-80be-4be2-802f-20af5361054d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:47.558138 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cf702da9-80be-4be2-802f-20af5361054d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:47.558804 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cf702da9-80be-4be2-802f-20af5361054d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:47.559260 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cf702da9-80be-4be2-802f-20af5361054d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:47.559715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cf702da9-80be-4be2-802f-20af5361054d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:47.784976 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-cf702da9-80be-4be2-802f-20af5361054d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:47.806464 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-cf702da9-80be-4be2-802f-20af5361054d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1314 microversion: 2.1 time: 0.263743 Sep 05 12:30:47.807038 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 105/215] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:47 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:48.316256 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-9c0bb837-93d9-4725-97ee-5b7c20df4c58 req-b1520ee4-32b0-4d50-81bb-68e6e17bb4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce1638f-9b04-4059-b2a6-633ebebbd3f6", "name": "network-vif-plugged", "status": "completed", "tag": "267484d6-bfdb-4495-a3ee-3e265d40b68e"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:30:48.328969 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-9c0bb837-93d9-4725-97ee-5b7c20df4c58 req-b1520ee4-32b0-4d50-81bb-68e6e17bb4d6 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:48.329478 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-9c0bb837-93d9-4725-97ee-5b7c20df4c58 req-b1520ee4-32b0-4d50-81bb-68e6e17bb4d6 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:48.329898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-9c0bb837-93d9-4725-97ee-5b7c20df4c58 req-b1520ee4-32b0-4d50-81bb-68e6e17bb4d6 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:48.341182 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-9c0bb837-93d9-4725-97ee-5b7c20df4c58 req-b1520ee4-32b0-4d50-81bb-68e6e17bb4d6 service nova] Creating event network-vif-plugged:267484d6-bfdb-4495-a3ee-3e265d40b68e for instance fce1638f-9b04-4059-b2a6-633ebebbd3f6 on hv-cinder-80135 Sep 05 12:30:48.346245 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-9c0bb837-93d9-4725-97ee-5b7c20df4c58 req-b1520ee4-32b0-4d50-81bb-68e6e17bb4d6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033645 Sep 05 12:30:48.346826 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 111/216] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:30:48.470486 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a5fb1436-341e-4b37-9023-f137db7be5f8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:48.471343 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a5fb1436-341e-4b37-9023-f137db7be5f8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:48.479119 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a5fb1436-341e-4b37-9023-f137db7be5f8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:48.479687 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a5fb1436-341e-4b37-9023-f137db7be5f8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:48.480125 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a5fb1436-341e-4b37-9023-f137db7be5f8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:48.480895 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a5fb1436-341e-4b37-9023-f137db7be5f8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:48.481356 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a5fb1436-341e-4b37-9023-f137db7be5f8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:48.481778 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a5fb1436-341e-4b37-9023-f137db7be5f8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:48.647455 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a5fb1436-341e-4b37-9023-f137db7be5f8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:48.655776 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a5fb1436-341e-4b37-9023-f137db7be5f8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.191875 Sep 05 12:30:48.656360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 106/217] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:48 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:48.844175 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1edc033a-b486-45d8-bb86-779b66690c3a tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:48.845023 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1edc033a-b486-45d8-bb86-779b66690c3a tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:48.853141 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1edc033a-b486-45d8-bb86-779b66690c3a tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:48.853844 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1edc033a-b486-45d8-bb86-779b66690c3a tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:48.854279 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1edc033a-b486-45d8-bb86-779b66690c3a tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:48.855236 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1edc033a-b486-45d8-bb86-779b66690c3a tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:48.855747 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1edc033a-b486-45d8-bb86-779b66690c3a tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:48.856181 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1edc033a-b486-45d8-bb86-779b66690c3a tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:48.999235 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1edc033a-b486-45d8-bb86-779b66690c3a tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:49.008037 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1edc033a-b486-45d8-bb86-779b66690c3a tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1314 microversion: 2.1 time: 0.168038 Sep 05 12:30:49.008704 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 112/218] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:48 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:49.684483 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-215846be-0937-4e2f-ad34-ab5e32722ebf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:49.685329 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-215846be-0937-4e2f-ad34-ab5e32722ebf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:49.700134 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-215846be-0937-4e2f-ad34-ab5e32722ebf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:49.707116 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-215846be-0937-4e2f-ad34-ab5e32722ebf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:49.707116 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-215846be-0937-4e2f-ad34-ab5e32722ebf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:49.707116 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-215846be-0937-4e2f-ad34-ab5e32722ebf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:49.707116 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-215846be-0937-4e2f-ad34-ab5e32722ebf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:49.709263 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-215846be-0937-4e2f-ad34-ab5e32722ebf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:49.910146 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-215846be-0937-4e2f-ad34-ab5e32722ebf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:49.926918 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-215846be-0937-4e2f-ad34-ab5e32722ebf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.246562 Sep 05 12:30:49.927506 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 107/219] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:49 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:50.031582 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-0b7e278d-ed16-4f3a-9bce-8159d85ae327 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:50.032888 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-0b7e278d-ed16-4f3a-9bce-8159d85ae327 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:50.039871 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0b7e278d-ed16-4f3a-9bce-8159d85ae327 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:50.040386 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0b7e278d-ed16-4f3a-9bce-8159d85ae327 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:50.049394 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0b7e278d-ed16-4f3a-9bce-8159d85ae327 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:50.049394 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0b7e278d-ed16-4f3a-9bce-8159d85ae327 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:50.049394 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0b7e278d-ed16-4f3a-9bce-8159d85ae327 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:50.049394 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0b7e278d-ed16-4f3a-9bce-8159d85ae327 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:50.205257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-0b7e278d-ed16-4f3a-9bce-8159d85ae327 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:50.213562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-0b7e278d-ed16-4f3a-9bce-8159d85ae327 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1314 microversion: 2.1 time: 0.185770 Sep 05 12:30:50.214144 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 113/220] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:50 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:50.957071 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-bbc096ea-d7d2-4eb4-a4a8-439c1acd0b18 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:50.958458 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-bbc096ea-d7d2-4eb4-a4a8-439c1acd0b18 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:50.965935 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bbc096ea-d7d2-4eb4-a4a8-439c1acd0b18 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:50.966664 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bbc096ea-d7d2-4eb4-a4a8-439c1acd0b18 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:50.967114 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bbc096ea-d7d2-4eb4-a4a8-439c1acd0b18 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:50.967932 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bbc096ea-d7d2-4eb4-a4a8-439c1acd0b18 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:50.968382 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bbc096ea-d7d2-4eb4-a4a8-439c1acd0b18 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:50.968813 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bbc096ea-d7d2-4eb4-a4a8-439c1acd0b18 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:51.106815 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-bbc096ea-d7d2-4eb4-a4a8-439c1acd0b18 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:51.116548 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-bbc096ea-d7d2-4eb4-a4a8-439c1acd0b18 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.164336 Sep 05 12:30:51.117134 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 108/221] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:50 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:51.237727 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-6db87c37-2f9a-487f-bdfc-afd83d66b5b8 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:51.243596 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-6db87c37-2f9a-487f-bdfc-afd83d66b5b8 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:51.248145 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6db87c37-2f9a-487f-bdfc-afd83d66b5b8 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:51.248726 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6db87c37-2f9a-487f-bdfc-afd83d66b5b8 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:51.249500 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6db87c37-2f9a-487f-bdfc-afd83d66b5b8 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:51.250566 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6db87c37-2f9a-487f-bdfc-afd83d66b5b8 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:51.251343 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6db87c37-2f9a-487f-bdfc-afd83d66b5b8 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:51.251683 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6db87c37-2f9a-487f-bdfc-afd83d66b5b8 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:51.575395 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6db87c37-2f9a-487f-bdfc-afd83d66b5b8 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:51.584918 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-6db87c37-2f9a-487f-bdfc-afd83d66b5b8 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1314 microversion: 2.1 time: 0.351138 Sep 05 12:30:51.588888 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 114/222] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:51 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:52.140209 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ac6aca46-99b7-4b51-b792-0e2df77f9a17 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:52.141088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ac6aca46-99b7-4b51-b792-0e2df77f9a17 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:52.148599 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ac6aca46-99b7-4b51-b792-0e2df77f9a17 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:52.149082 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ac6aca46-99b7-4b51-b792-0e2df77f9a17 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:52.149510 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ac6aca46-99b7-4b51-b792-0e2df77f9a17 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:52.150350 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ac6aca46-99b7-4b51-b792-0e2df77f9a17 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:52.150792 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ac6aca46-99b7-4b51-b792-0e2df77f9a17 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:52.151275 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ac6aca46-99b7-4b51-b792-0e2df77f9a17 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:52.309369 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ac6aca46-99b7-4b51-b792-0e2df77f9a17 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:52.319124 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ac6aca46-99b7-4b51-b792-0e2df77f9a17 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.182788 Sep 05 12:30:52.319977 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 109/223] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:52 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:30:52.611682 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-73aab3b7-c270-4e04-8f98-a9772b9443d6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:52.612311 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-73aab3b7-c270-4e04-8f98-a9772b9443d6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:52.619112 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-73aab3b7-c270-4e04-8f98-a9772b9443d6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:52.620499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-73aab3b7-c270-4e04-8f98-a9772b9443d6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:52.620499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-73aab3b7-c270-4e04-8f98-a9772b9443d6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:52.620933 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-73aab3b7-c270-4e04-8f98-a9772b9443d6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:52.621382 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-73aab3b7-c270-4e04-8f98-a9772b9443d6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:52.621806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-73aab3b7-c270-4e04-8f98-a9772b9443d6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:52.882636 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-73aab3b7-c270-4e04-8f98-a9772b9443d6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:52.891403 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-73aab3b7-c270-4e04-8f98-a9772b9443d6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1314 microversion: 2.1 time: 0.284305 Sep 05 12:30:52.892637 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 115/224] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:52 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:53.351331 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-9cfd7d98-d433-45b5-b547-f281a4eaf0c5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:53.353487 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-9cfd7d98-d433-45b5-b547-f281a4eaf0c5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:53.360668 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9cfd7d98-d433-45b5-b547-f281a4eaf0c5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:53.362032 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9cfd7d98-d433-45b5-b547-f281a4eaf0c5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:53.362718 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9cfd7d98-d433-45b5-b547-f281a4eaf0c5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:53.364067 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9cfd7d98-d433-45b5-b547-f281a4eaf0c5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:53.364763 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9cfd7d98-d433-45b5-b547-f281a4eaf0c5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:53.365414 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9cfd7d98-d433-45b5-b547-f281a4eaf0c5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:53.387885 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=100 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:53.658898 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-9cfd7d98-d433-45b5-b547-f281a4eaf0c5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:53.668685 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-9cfd7d98-d433-45b5-b547-f281a4eaf0c5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1522 microversion: 2.1 time: 0.323820 Sep 05 12:30:53.670505 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 110/225] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:53 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:53.923964 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-82b9f7cf-a4fe-40ab-b547-d40783e24e43 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:53.926003 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-82b9f7cf-a4fe-40ab-b547-d40783e24e43 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:53.929731 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=60 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:53.933669 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-82b9f7cf-a4fe-40ab-b547-d40783e24e43 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:53.934159 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-82b9f7cf-a4fe-40ab-b547-d40783e24e43 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:53.934590 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-82b9f7cf-a4fe-40ab-b547-d40783e24e43 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:53.935297 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-82b9f7cf-a4fe-40ab-b547-d40783e24e43 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:53.935947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-82b9f7cf-a4fe-40ab-b547-d40783e24e43 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:53.936364 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-82b9f7cf-a4fe-40ab-b547-d40783e24e43 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:54.215806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-82b9f7cf-a4fe-40ab-b547-d40783e24e43 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:54.223993 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-82b9f7cf-a4fe-40ab-b547-d40783e24e43 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1314 microversion: 2.1 time: 0.312927 Sep 05 12:30:54.224630 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 116/226] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:53 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:54.700372 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c8591054-c4c4-4739-acc5-194197aad832 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:54.702657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-c8591054-c4c4-4739-acc5-194197aad832 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:54.723254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c8591054-c4c4-4739-acc5-194197aad832 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:54.723874 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c8591054-c4c4-4739-acc5-194197aad832 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:54.724244 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c8591054-c4c4-4739-acc5-194197aad832 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:54.724959 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c8591054-c4c4-4739-acc5-194197aad832 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:54.725420 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c8591054-c4c4-4739-acc5-194197aad832 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:54.725848 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c8591054-c4c4-4739-acc5-194197aad832 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:54.990802 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c8591054-c4c4-4739-acc5-194197aad832 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:55.004080 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-c8591054-c4c4-4739-acc5-194197aad832 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1502 microversion: 2.1 time: 0.311291 Sep 05 12:30:55.005142 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 111/227] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:54 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1502 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:55.044852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1d112826-cefb-407b-adb4-a1bfb2b5fb45 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:55.045690 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1d112826-cefb-407b-adb4-a1bfb2b5fb45 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:55.058788 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1d112826-cefb-407b-adb4-a1bfb2b5fb45 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:55.059491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1d112826-cefb-407b-adb4-a1bfb2b5fb45 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:55.060114 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1d112826-cefb-407b-adb4-a1bfb2b5fb45 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:55.060993 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1d112826-cefb-407b-adb4-a1bfb2b5fb45 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:55.061607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1d112826-cefb-407b-adb4-a1bfb2b5fb45 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:55.066418 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1d112826-cefb-407b-adb4-a1bfb2b5fb45 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:55.252410 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7b83e552-b982-41f0-8be1-567be11b3246 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:55.253442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-7b83e552-b982-41f0-8be1-567be11b3246 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:55.271152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7b83e552-b982-41f0-8be1-567be11b3246 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:55.272014 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7b83e552-b982-41f0-8be1-567be11b3246 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:55.272785 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7b83e552-b982-41f0-8be1-567be11b3246 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:55.275620 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7b83e552-b982-41f0-8be1-567be11b3246 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:55.276456 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7b83e552-b982-41f0-8be1-567be11b3246 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:55.278351 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7b83e552-b982-41f0-8be1-567be11b3246 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:55.304242 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1d112826-cefb-407b-adb4-a1bfb2b5fb45 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:55.334732 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1d112826-cefb-407b-adb4-a1bfb2b5fb45 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1517 microversion: 2.1 time: 0.293189 Sep 05 12:30:55.336387 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 117/228] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:55 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1517 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:30:55.684326 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-7b83e552-b982-41f0-8be1-567be11b3246 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:55.694649 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-7b83e552-b982-41f0-8be1-567be11b3246 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1496 microversion: 2.1 time: 0.448139 Sep 05 12:30:55.695153 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 112/229] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:55 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1496 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:57.183059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-781ae2a3-6291-47b7-9b38-e0368c120bd7 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:57.184783 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-781ae2a3-6291-47b7-9b38-e0368c120bd7 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:57.199593 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-781ae2a3-6291-47b7-9b38-e0368c120bd7 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:57.200347 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-781ae2a3-6291-47b7-9b38-e0368c120bd7 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:57.200956 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-781ae2a3-6291-47b7-9b38-e0368c120bd7 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:57.201938 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-781ae2a3-6291-47b7-9b38-e0368c120bd7 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:57.203135 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-781ae2a3-6291-47b7-9b38-e0368c120bd7 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:57.203962 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-781ae2a3-6291-47b7-9b38-e0368c120bd7 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:57.238602 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-781ae2a3-6291-47b7-9b38-e0368c120bd7 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Going to try to terminate instance {{(pid=121210) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:30:57.627142 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-17aebe45-d90f-441d-a043-95674a634c0b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:30:57.631323 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-17aebe45-d90f-441d-a043-95674a634c0b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:57.649650 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-17aebe45-d90f-441d-a043-95674a634c0b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:57.650208 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-17aebe45-d90f-441d-a043-95674a634c0b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:57.650782 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-17aebe45-d90f-441d-a043-95674a634c0b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:57.651530 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-17aebe45-d90f-441d-a043-95674a634c0b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:57.652097 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-17aebe45-d90f-441d-a043-95674a634c0b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:57.652433 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-17aebe45-d90f-441d-a043-95674a634c0b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:57.667897 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-781ae2a3-6291-47b7-9b38-e0368c120bd7 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "DELETE /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 204 len: 0 microversion: 2.1 time: 0.489216 Sep 05 12:30:57.668480 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 118/230] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:30:57 2022] DELETE /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:30:57.677885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-59739ef6-2405-41ac-b16e-5dd68575dd78 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:57.684857 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-59739ef6-2405-41ac-b16e-5dd68575dd78 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:57.688065 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-59739ef6-2405-41ac-b16e-5dd68575dd78 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:57.689845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-59739ef6-2405-41ac-b16e-5dd68575dd78 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:57.693213 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-59739ef6-2405-41ac-b16e-5dd68575dd78 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:57.694243 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-59739ef6-2405-41ac-b16e-5dd68575dd78 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:57.696074 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-59739ef6-2405-41ac-b16e-5dd68575dd78 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:57.696706 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-59739ef6-2405-41ac-b16e-5dd68575dd78 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:57.702552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.objects.instance [None req-17aebe45-d90f-441d-a043-95674a634c0b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lazy-loading 'flavor' on Instance uuid 83fdb4c3-ab13-406e-8f5c-a8a7e481374f {{(pid=121211) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:30:57.916465 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-59739ef6-2405-41ac-b16e-5dd68575dd78 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:57.929426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-59739ef6-2405-41ac-b16e-5dd68575dd78 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1502 microversion: 2.1 time: 0.255348 Sep 05 12:30:57.933778 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 119/231] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:57 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1502 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:58.057008 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-17aebe45-d90f-441d-a043-95674a634c0b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "POST /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f/action" status: 200 len: 32 microversion: 2.1 time: 0.435373 Sep 05 12:30:58.057685 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 113/232] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Sep 5 12:30:57 2022] POST /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f/action => generated 32 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 05 12:30:58.068380 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-056c707a-9f96-4bcf-add0-b656d47f7669 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:58.069353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-056c707a-9f96-4bcf-add0-b656d47f7669 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:58.079229 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-056c707a-9f96-4bcf-add0-b656d47f7669 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:58.079835 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-056c707a-9f96-4bcf-add0-b656d47f7669 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:58.080345 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-056c707a-9f96-4bcf-add0-b656d47f7669 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:58.081132 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-056c707a-9f96-4bcf-add0-b656d47f7669 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:58.081657 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-056c707a-9f96-4bcf-add0-b656d47f7669 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:58.082551 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-056c707a-9f96-4bcf-add0-b656d47f7669 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:58.250815 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-056c707a-9f96-4bcf-add0-b656d47f7669 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:58.262042 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-056c707a-9f96-4bcf-add0-b656d47f7669 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.198522 Sep 05 12:30:58.267749 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 120/233] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:58 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:58.964546 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1610ce87-47b7-4831-b69f-9ce8df98e98d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:58.964546 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1610ce87-47b7-4831-b69f-9ce8df98e98d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:58.967250 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1610ce87-47b7-4831-b69f-9ce8df98e98d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:58.977068 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1610ce87-47b7-4831-b69f-9ce8df98e98d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:58.977068 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1610ce87-47b7-4831-b69f-9ce8df98e98d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:58.977068 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1610ce87-47b7-4831-b69f-9ce8df98e98d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:58.977068 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1610ce87-47b7-4831-b69f-9ce8df98e98d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:58.977382 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1610ce87-47b7-4831-b69f-9ce8df98e98d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:59.180189 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1610ce87-47b7-4831-b69f-9ce8df98e98d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:59.187790 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1610ce87-47b7-4831-b69f-9ce8df98e98d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1502 microversion: 2.1 time: 0.234548 Sep 05 12:30:59.208503 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 114/234] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:58 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1502 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:30:59.287110 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-2716162f-6546-43f5-8e46-4b8a6baf7aa2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:30:59.287747 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-2716162f-6546-43f5-8e46-4b8a6baf7aa2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:30:59.294572 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2716162f-6546-43f5-8e46-4b8a6baf7aa2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:59.295062 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2716162f-6546-43f5-8e46-4b8a6baf7aa2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:59.295745 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2716162f-6546-43f5-8e46-4b8a6baf7aa2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:59.296475 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2716162f-6546-43f5-8e46-4b8a6baf7aa2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:30:59.296974 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2716162f-6546-43f5-8e46-4b8a6baf7aa2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:30:59.297390 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2716162f-6546-43f5-8e46-4b8a6baf7aa2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:30:59.454244 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-2716162f-6546-43f5-8e46-4b8a6baf7aa2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:30:59.472238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-2716162f-6546-43f5-8e46-4b8a6baf7aa2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.183544 Sep 05 12:30:59.472238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 121/235] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:30:59 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:00.211888 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-2ee02c32-7473-4c10-b997-71d96b41f176 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:00.212624 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-2ee02c32-7473-4c10-b997-71d96b41f176 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:00.220781 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2ee02c32-7473-4c10-b997-71d96b41f176 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:00.222163 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2ee02c32-7473-4c10-b997-71d96b41f176 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:00.222668 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2ee02c32-7473-4c10-b997-71d96b41f176 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:00.224074 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2ee02c32-7473-4c10-b997-71d96b41f176 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:00.224748 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2ee02c32-7473-4c10-b997-71d96b41f176 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:00.238164 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2ee02c32-7473-4c10-b997-71d96b41f176 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:00.351436 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-2ee02c32-7473-4c10-b997-71d96b41f176 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:00.378884 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-2ee02c32-7473-4c10-b997-71d96b41f176 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1460 microversion: 2.1 time: 0.171753 Sep 05 12:31:00.379477 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 115/236] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:00 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1460 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:00.413365 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-9da25285-2836-4f39-8041-a8db932b1cee req-b80700d7-8f19-4b1d-a9d7-c81af6a74dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce1638f-9b04-4059-b2a6-633ebebbd3f6", "name": "network-vif-deleted", "tag": "267484d6-bfdb-4495-a3ee-3e265d40b68e"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:31:00.426392 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-9da25285-2836-4f39-8041-a8db932b1cee req-b80700d7-8f19-4b1d-a9d7-c81af6a74dfd service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:00.427218 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-9da25285-2836-4f39-8041-a8db932b1cee req-b80700d7-8f19-4b1d-a9d7-c81af6a74dfd service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:00.427850 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-9da25285-2836-4f39-8041-a8db932b1cee req-b80700d7-8f19-4b1d-a9d7-c81af6a74dfd service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:00.433355 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:00.443071 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-9da25285-2836-4f39-8041-a8db932b1cee req-b80700d7-8f19-4b1d-a9d7-c81af6a74dfd service nova] Creating event network-vif-deleted:267484d6-bfdb-4495-a3ee-3e265d40b68e for instance fce1638f-9b04-4059-b2a6-633ebebbd3f6 on hv-cinder-80135 Sep 05 12:31:00.449811 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-9da25285-2836-4f39-8041-a8db932b1cee req-b80700d7-8f19-4b1d-a9d7-c81af6a74dfd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040754 Sep 05 12:31:00.451295 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 122/237] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:31:00.493166 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-928110ed-14af-47aa-8c53-d79b04f1a7bf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:00.493878 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-928110ed-14af-47aa-8c53-d79b04f1a7bf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:00.501156 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-928110ed-14af-47aa-8c53-d79b04f1a7bf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:00.502467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-928110ed-14af-47aa-8c53-d79b04f1a7bf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:00.503075 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-928110ed-14af-47aa-8c53-d79b04f1a7bf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:00.504019 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-928110ed-14af-47aa-8c53-d79b04f1a7bf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:00.505808 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-928110ed-14af-47aa-8c53-d79b04f1a7bf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:00.506721 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-928110ed-14af-47aa-8c53-d79b04f1a7bf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:00.735184 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-928110ed-14af-47aa-8c53-d79b04f1a7bf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:00.759208 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-928110ed-14af-47aa-8c53-d79b04f1a7bf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.272646 Sep 05 12:31:00.781025 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 116/238] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:00 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:01.410286 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d5d6e144-c256-41d0-9f67-8c1dae37c4c0 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:01.414692 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d5d6e144-c256-41d0-9f67-8c1dae37c4c0 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:01.450846 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d5d6e144-c256-41d0-9f67-8c1dae37c4c0 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:01.450846 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d5d6e144-c256-41d0-9f67-8c1dae37c4c0 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:01.450846 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d5d6e144-c256-41d0-9f67-8c1dae37c4c0 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:01.456216 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d5d6e144-c256-41d0-9f67-8c1dae37c4c0 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:01.457016 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d5d6e144-c256-41d0-9f67-8c1dae37c4c0 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:01.457653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d5d6e144-c256-41d0-9f67-8c1dae37c4c0 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:01.499860 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d5d6e144-c256-41d0-9f67-8c1dae37c4c0 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:01.504197 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d5d6e144-c256-41d0-9f67-8c1dae37c4c0 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:01.504197 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d5d6e144-c256-41d0-9f67-8c1dae37c4c0 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:01.504197 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-d5d6e144-c256-41d0-9f67-8c1dae37c4c0 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lazy-loading 'fault' on Instance uuid fce1638f-9b04-4059-b2a6-633ebebbd3f6 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:31:01.586697 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d5d6e144-c256-41d0-9f67-8c1dae37c4c0 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:01.599399 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d5d6e144-c256-41d0-9f67-8c1dae37c4c0 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1304 microversion: 2.1 time: 0.198415 Sep 05 12:31:01.603492 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 123/239] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:01 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1304 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:01.782558 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d86d1ee7-c3a6-4f04-a550-c77d622c77ed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:01.783171 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d86d1ee7-c3a6-4f04-a550-c77d622c77ed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:01.789927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d86d1ee7-c3a6-4f04-a550-c77d622c77ed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:01.790410 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d86d1ee7-c3a6-4f04-a550-c77d622c77ed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:01.790844 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d86d1ee7-c3a6-4f04-a550-c77d622c77ed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:01.791555 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d86d1ee7-c3a6-4f04-a550-c77d622c77ed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:01.792034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d86d1ee7-c3a6-4f04-a550-c77d622c77ed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:01.792483 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d86d1ee7-c3a6-4f04-a550-c77d622c77ed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:02.000321 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d86d1ee7-c3a6-4f04-a550-c77d622c77ed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:02.015190 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d86d1ee7-c3a6-4f04-a550-c77d622c77ed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.237000 Sep 05 12:31:02.016490 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 117/240] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:01 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:02.625089 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-05d4c3ed-dddd-4057-9754-f1ea1a43c694 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:02.625662 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-05d4c3ed-dddd-4057-9754-f1ea1a43c694 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:02.639361 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-05d4c3ed-dddd-4057-9754-f1ea1a43c694 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:02.639893 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-05d4c3ed-dddd-4057-9754-f1ea1a43c694 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:02.640324 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-05d4c3ed-dddd-4057-9754-f1ea1a43c694 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:02.641036 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-05d4c3ed-dddd-4057-9754-f1ea1a43c694 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:02.642040 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-05d4c3ed-dddd-4057-9754-f1ea1a43c694 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:02.642040 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-05d4c3ed-dddd-4057-9754-f1ea1a43c694 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:02.700907 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-05d4c3ed-dddd-4057-9754-f1ea1a43c694 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:02.701660 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-05d4c3ed-dddd-4057-9754-f1ea1a43c694 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:02.702403 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-05d4c3ed-dddd-4057-9754-f1ea1a43c694 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:02.703095 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-05d4c3ed-dddd-4057-9754-f1ea1a43c694 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lazy-loading 'fault' on Instance uuid fce1638f-9b04-4059-b2a6-633ebebbd3f6 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:31:02.767358 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-05d4c3ed-dddd-4057-9754-f1ea1a43c694 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:02.782325 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-05d4c3ed-dddd-4057-9754-f1ea1a43c694 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1304 microversion: 2.1 time: 0.161530 Sep 05 12:31:02.787246 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 124/241] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:02 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1304 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:03.040420 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-58712c5d-4dec-4d42-9e52-494c714c0dc7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:03.041220 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-58712c5d-4dec-4d42-9e52-494c714c0dc7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:03.060078 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-58712c5d-4dec-4d42-9e52-494c714c0dc7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:03.067918 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-58712c5d-4dec-4d42-9e52-494c714c0dc7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:03.073036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-58712c5d-4dec-4d42-9e52-494c714c0dc7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:03.076470 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-58712c5d-4dec-4d42-9e52-494c714c0dc7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:03.084404 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-58712c5d-4dec-4d42-9e52-494c714c0dc7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:03.084969 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-58712c5d-4dec-4d42-9e52-494c714c0dc7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:03.408846 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-58712c5d-4dec-4d42-9e52-494c714c0dc7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:03.421096 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-58712c5d-4dec-4d42-9e52-494c714c0dc7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.386311 Sep 05 12:31:03.423788 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 118/242] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:03 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:03.811018 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-b8acb066-941c-4bce-9e87-436d7f9b25b4 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:03.811927 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-b8acb066-941c-4bce-9e87-436d7f9b25b4 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:03.819251 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b8acb066-941c-4bce-9e87-436d7f9b25b4 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:03.826030 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b8acb066-941c-4bce-9e87-436d7f9b25b4 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:03.829679 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b8acb066-941c-4bce-9e87-436d7f9b25b4 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:03.830575 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b8acb066-941c-4bce-9e87-436d7f9b25b4 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:03.831153 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b8acb066-941c-4bce-9e87-436d7f9b25b4 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:03.831725 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b8acb066-941c-4bce-9e87-436d7f9b25b4 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:03.881441 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b8acb066-941c-4bce-9e87-436d7f9b25b4 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:03.882176 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b8acb066-941c-4bce-9e87-436d7f9b25b4 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:03.882756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b8acb066-941c-4bce-9e87-436d7f9b25b4 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:03.883351 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-b8acb066-941c-4bce-9e87-436d7f9b25b4 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lazy-loading 'fault' on Instance uuid fce1638f-9b04-4059-b2a6-633ebebbd3f6 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:31:03.995108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-b8acb066-941c-4bce-9e87-436d7f9b25b4 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:04.013031 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-b8acb066-941c-4bce-9e87-436d7f9b25b4 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 200 len: 1304 microversion: 2.1 time: 0.203878 Sep 05 12:31:04.016125 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 125/243] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:03 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 1304 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:04.450734 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-44d5fdc6-4306-4e81-8fe7-1746b5de9b1a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:04.451601 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-44d5fdc6-4306-4e81-8fe7-1746b5de9b1a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:04.473156 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-44d5fdc6-4306-4e81-8fe7-1746b5de9b1a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:04.473156 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-44d5fdc6-4306-4e81-8fe7-1746b5de9b1a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:04.473156 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-44d5fdc6-4306-4e81-8fe7-1746b5de9b1a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:04.473156 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-44d5fdc6-4306-4e81-8fe7-1746b5de9b1a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:04.474165 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-44d5fdc6-4306-4e81-8fe7-1746b5de9b1a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:04.474165 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-44d5fdc6-4306-4e81-8fe7-1746b5de9b1a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:04.711378 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-44d5fdc6-4306-4e81-8fe7-1746b5de9b1a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:04.722790 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-44d5fdc6-4306-4e81-8fe7-1746b5de9b1a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.276504 Sep 05 12:31:04.723504 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 119/244] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:04 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:05.054372 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-5593a9e8-2b1c-4099-a585-82ae19668aba tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:05.055144 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-5593a9e8-2b1c-4099-a585-82ae19668aba tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: fce1638f-9b04-4059-b2a6-633ebebbd3f6] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:05.069670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5593a9e8-2b1c-4099-a585-82ae19668aba tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:05.071067 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5593a9e8-2b1c-4099-a585-82ae19668aba tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:05.071693 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5593a9e8-2b1c-4099-a585-82ae19668aba tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:05.072343 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5593a9e8-2b1c-4099-a585-82ae19668aba tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:05.073520 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5593a9e8-2b1c-4099-a585-82ae19668aba tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:05.073984 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5593a9e8-2b1c-4099-a585-82ae19668aba tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:05.091656 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-5593a9e8-2b1c-4099-a585-82ae19668aba tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] HTTP exception thrown: Instance fce1638f-9b04-4059-b2a6-633ebebbd3f6 could not be found. Sep 05 12:31:05.093342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-5593a9e8-2b1c-4099-a585-82ae19668aba tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Request method failure captured: Sep 05 12:31:05.093342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 HTTP/1.1 Sep 05 12:31:05.093342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:31:05.093342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:31:05.093342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:31:05.093342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:31:05.093342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:31:05.093342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:31:05.093342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:31:05.093342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:31:05.093342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFevlVa6TaakpknHyKf6F8E9QLm9gnoNWcihznEhqbrtd9M8WG_Cogr1TpXN6ulECpF4CRrboEa_RKMg5h_9U5lKrFph2fJ2hfE3pn06s5bbpj0kVqYBvbrS79cLT5VTXqVmMzi5lQmYCXklK17P-jbzMp-a2v2eMb_IRrjbgCWNYhVg Sep 05 12:31:05.093342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:31:05.093342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:31:05.093342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:31:05.093342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:31:05.093342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:31:05.093342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:31:05.093342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: d5ecc5cd1d854b17bbe9ee678ecacfe3 Sep 05 12:31:05.093342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-VolumesActionsTest-1274481575 Sep 05 12:31:05.093342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:31:05.093342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:31:05.094563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d5ecc5cd1d854b17bbe9ee678ecacfe3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d5ecc5cd1d854b17bbe9ee678ecacfe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d5ecc5cd1d854b17bbe9ee678ecacfe3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d5ecc5cd1d854b17bbe9ee678ecacfe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:31:05.094563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-VolumesActionsTest-1274481575 Sep 05 12:31:05.094563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: d5ecc5cd1d854b17bbe9ee678ecacfe3 Sep 05 12:31:05.094563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-VolumesActionsTest-1274481575 Sep 05 12:31:05.094563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-VolumesActionsTest-1274481575-project Sep 05 12:31:05.094563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:31:05.094563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:31:05.094563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: a669f6cbac5a4d84a9e71c27c01969ff Sep 05 12:31:05.094563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-VolumesActionsTest-1274481575-project Sep 05 12:31:05.094563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:31:05.094563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance fce1638f-9b04-4059-b2a6-633ebebbd3f6 could not be found. Sep 05 12:31:05.094563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': 'fce1638f-9b04-4059-b2a6-633ebebbd3f6'} Sep 05 12:31:05.095366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:31:05.095366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:31:05.095366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:31:05.095366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:31:05.095366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:31:05.095366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:31:05.095366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:31:05.095366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:31:05.095366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:31:05.095366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:31:05.095366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce1638f-9b04-4059-b2a6-633ebebbd3f6 could not be found. Sep 05 12:31:05.095366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:31:05.095366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:31:05.095366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:31:05.095366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:31:05.095366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:31:05.095366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:31:05.095366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:31:05.095366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:31:05.095366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:31:05.096607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:31:05.096607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:31:05.096607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:31:05.096607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:31:05.096607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:31:05.096607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:31:05.096607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:31:05.096607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce1638f-9b04-4059-b2a6-633ebebbd3f6 could not be found. Sep 05 12:31:05.096607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:31:05.096607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:31:05.096607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:31:05.096607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:31:05.096607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:31:05.096607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:31:05.096607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:31:05.096607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:31:05.096607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce1638f-9b04-4059-b2a6-633ebebbd3f6 could not be found. Sep 05 12:31:05.096607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:31:05.098977 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-5593a9e8-2b1c-4099-a585-82ae19668aba tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Returning 404 to user: Instance fce1638f-9b04-4059-b2a6-633ebebbd3f6 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:31:05.098977 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-5593a9e8-2b1c-4099-a585-82ae19668aba tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6" status: 404 len: 111 microversion: 2.1 time: 0.055479 Sep 05 12:31:05.098977 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 126/245] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:05 2022] GET /compute/v2.1/servers/fce1638f-9b04-4059-b2a6-633ebebbd3f6 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:31:05.208518 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-cb2f000e-4641-456d-bcfc-ba04fad413d3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1275553218", "imageRef": "7844cf5b-4975-4cb9-a7f8-31cc5e52098a", "flavorRef": "452", "networks": [{"uuid": "488a601a-db3c-42c3-a1b1-31b43872e2ec"}]}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:31:05.272451 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.network.neutron [None req-cb2f000e-4641-456d-bcfc-ba04fad413d3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] validate_networks() for [('488a601a-db3c-42c3-a1b1-31b43872e2ec', None, None, None, None, None)] {{(pid=121211) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:31:05.753605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-0d3a5e2a-874b-45c3-a0d2-85f2d282585d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:05.754285 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-0d3a5e2a-874b-45c3-a0d2-85f2d282585d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:05.763994 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0d3a5e2a-874b-45c3-a0d2-85f2d282585d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:05.765148 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0d3a5e2a-874b-45c3-a0d2-85f2d282585d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:05.767746 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0d3a5e2a-874b-45c3-a0d2-85f2d282585d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:05.767746 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0d3a5e2a-874b-45c3-a0d2-85f2d282585d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:05.767746 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0d3a5e2a-874b-45c3-a0d2-85f2d282585d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:05.767746 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0d3a5e2a-874b-45c3-a0d2-85f2d282585d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:05.940451 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-0d3a5e2a-874b-45c3-a0d2-85f2d282585d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:05.951225 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-0d3a5e2a-874b-45c3-a0d2-85f2d282585d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.205898 Sep 05 12:31:05.952292 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 127/246] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:05 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:05.969766 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-cb2f000e-4641-456d-bcfc-ba04fad413d3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Flavor limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:31:05.971306 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-cb2f000e-4641-456d-bcfc-ba04fad413d3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Image limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:31:05.971851 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-cb2f000e-4641-456d-bcfc-ba04fad413d3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Flavor pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:31:05.972271 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-cb2f000e-4641-456d-bcfc-ba04fad413d3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Image pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:31:05.973291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-cb2f000e-4641-456d-bcfc-ba04fad413d3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:31:05.993376 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cb2f000e-4641-456d-bcfc-ba04fad413d3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:05.994426 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cb2f000e-4641-456d-bcfc-ba04fad413d3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:05.996945 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cb2f000e-4641-456d-bcfc-ba04fad413d3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:05.998040 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cb2f000e-4641-456d-bcfc-ba04fad413d3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:06.000154 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cb2f000e-4641-456d-bcfc-ba04fad413d3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:06.002401 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cb2f000e-4641-456d-bcfc-ba04fad413d3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:06.032846 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-cb2f000e-4641-456d-bcfc-ba04fad413d3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Getting quotas for project d5ecc5cd1d854b17bbe9ee678ecacfe3. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:31:06.038880 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-cb2f000e-4641-456d-bcfc-ba04fad413d3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Getting quotas for user a669f6cbac5a4d84a9e71c27c01969ff and project d5ecc5cd1d854b17bbe9ee678ecacfe3. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:31:06.078301 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-cb2f000e-4641-456d-bcfc-ba04fad413d3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Going to run 1 instances... {{(pid=121211) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:31:06.083355 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-cb2f000e-4641-456d-bcfc-ba04fad413d3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7844cf5b-4975-4cb9-a7f8-31cc5e52098a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121211) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:31:06.287667 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-cb2f000e-4641-456d-bcfc-ba04fad413d3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.084150 Sep 05 12:31:06.288623 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 120/247] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Sep 5 12:31:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:31:06.300511 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-c83c954b-fcc2-4f64-b97c-43ecd7d6f6d4 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:06.301125 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-c83c954b-fcc2-4f64-b97c-43ecd7d6f6d4 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:06.372686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c83c954b-fcc2-4f64-b97c-43ecd7d6f6d4 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:06.390220 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-c83c954b-fcc2-4f64-b97c-43ecd7d6f6d4 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1214 microversion: 2.1 time: 0.094471 Sep 05 12:31:06.399145 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 128/248] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:06 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:06.976511 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-91b7b354-f06f-4cba-a121-7765ef03d31a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:06.978783 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-91b7b354-f06f-4cba-a121-7765ef03d31a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:06.991837 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-91b7b354-f06f-4cba-a121-7765ef03d31a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:06.993008 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-91b7b354-f06f-4cba-a121-7765ef03d31a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:06.993450 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-91b7b354-f06f-4cba-a121-7765ef03d31a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:06.994303 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-91b7b354-f06f-4cba-a121-7765ef03d31a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:06.995734 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-91b7b354-f06f-4cba-a121-7765ef03d31a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:06.996350 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-91b7b354-f06f-4cba-a121-7765ef03d31a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:07.240985 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-91b7b354-f06f-4cba-a121-7765ef03d31a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:07.253021 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-91b7b354-f06f-4cba-a121-7765ef03d31a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.281003 Sep 05 12:31:07.253608 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 121/249] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:06 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:07.428099 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d950e774-be6d-45fd-bb70-94bbca6b85d1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:07.428099 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d950e774-be6d-45fd-bb70-94bbca6b85d1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:07.433344 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d950e774-be6d-45fd-bb70-94bbca6b85d1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:07.434058 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d950e774-be6d-45fd-bb70-94bbca6b85d1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:07.434624 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d950e774-be6d-45fd-bb70-94bbca6b85d1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:07.435870 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d950e774-be6d-45fd-bb70-94bbca6b85d1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:07.436428 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d950e774-be6d-45fd-bb70-94bbca6b85d1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:07.436949 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d950e774-be6d-45fd-bb70-94bbca6b85d1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:07.529909 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d950e774-be6d-45fd-bb70-94bbca6b85d1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:07.538902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d950e774-be6d-45fd-bb70-94bbca6b85d1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1218 microversion: 2.1 time: 0.123752 Sep 05 12:31:07.554384 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 129/250] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:07 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:08.072267 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8aefac45-966e-44df-aea0-6391ff46fac1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Action: 'create', calling method: .version_select at 0x7fe712a90af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-384624755", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHk7QW6JpOs+dYubfXFH/W4AFCmMtcAfXAntOrqFjHJEz/E7j51JYy3zMJsUY4aYL1QYyVuFfbmELgvBR6GNBISxJ5jPpNyTlck7eyddy5YiXJldAG2G69aOlz9LrFDq6Q=="}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:31:08.088152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-8aefac45-966e-44df-aea0-6391ff46fac1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Getting quotas for project 4377cb4a93524abd99acb6ebe07fd1d6. Resources: {'key_pairs'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:31:08.092615 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-8aefac45-966e-44df-aea0-6391ff46fac1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Getting quotas for user e7a29212dfae4a93beea7d11085cde63 and project 4377cb4a93524abd99acb6ebe07fd1d6. Resources: {'key_pairs'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:31:08.237256 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-8aefac45-966e-44df-aea0-6391ff46fac1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.367384 Sep 05 12:31:08.237780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 122/251] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Sep 5 12:31:07 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:31:08.277073 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-bff0a086-241e-4225-b3ff-051146566093 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:08.277674 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-bff0a086-241e-4225-b3ff-051146566093 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:08.283783 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bff0a086-241e-4225-b3ff-051146566093 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:08.289968 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bff0a086-241e-4225-b3ff-051146566093 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:08.289968 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bff0a086-241e-4225-b3ff-051146566093 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:08.289968 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bff0a086-241e-4225-b3ff-051146566093 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:08.289968 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bff0a086-241e-4225-b3ff-051146566093 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:08.290375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bff0a086-241e-4225-b3ff-051146566093 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:08.420214 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-bff0a086-241e-4225-b3ff-051146566093 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:08.429361 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-bff0a086-241e-4225-b3ff-051146566093 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.156091 Sep 05 12:31:08.430000 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 130/252] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:08 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:08.561356 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-362670e3-d0f5-47ad-b190-567cb1596e6b tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:08.562156 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-362670e3-d0f5-47ad-b190-567cb1596e6b tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:08.569720 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-362670e3-d0f5-47ad-b190-567cb1596e6b tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:08.570208 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-362670e3-d0f5-47ad-b190-567cb1596e6b tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:08.570640 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-362670e3-d0f5-47ad-b190-567cb1596e6b tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:08.571346 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-362670e3-d0f5-47ad-b190-567cb1596e6b tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:08.571886 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-362670e3-d0f5-47ad-b190-567cb1596e6b tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:08.572313 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-362670e3-d0f5-47ad-b190-567cb1596e6b tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:08.717424 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-362670e3-d0f5-47ad-b190-567cb1596e6b tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:08.725193 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-362670e3-d0f5-47ad-b190-567cb1596e6b tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1218 microversion: 2.1 time: 0.167805 Sep 05 12:31:08.725832 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 123/253] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:08 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1218 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:09.033412 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-3f0fe825-cf9a-4a81-86cd-55fcf1f4a85a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:09.033911 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-3f0fe825-cf9a-4a81-86cd-55fcf1f4a85a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:09.040110 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3f0fe825-cf9a-4a81-86cd-55fcf1f4a85a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:09.040597 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3f0fe825-cf9a-4a81-86cd-55fcf1f4a85a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:09.041026 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3f0fe825-cf9a-4a81-86cd-55fcf1f4a85a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:09.041724 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3f0fe825-cf9a-4a81-86cd-55fcf1f4a85a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:09.042174 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3f0fe825-cf9a-4a81-86cd-55fcf1f4a85a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:09.042596 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3f0fe825-cf9a-4a81-86cd-55fcf1f4a85a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:09.070227 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-3f0fe825-cf9a-4a81-86cd-55fcf1f4a85a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/ips" status: 200 len: 149 microversion: 2.1 time: 0.040989 Sep 05 12:31:09.070835 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 131/254] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Sep 5 12:31:09 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:31:09.457782 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-b421f27c-eef7-49ac-b48c-51b050dacf1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:09.458459 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-b421f27c-eef7-49ac-b48c-51b050dacf1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:09.465526 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b421f27c-eef7-49ac-b48c-51b050dacf1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:09.466022 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b421f27c-eef7-49ac-b48c-51b050dacf1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:09.466462 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b421f27c-eef7-49ac-b48c-51b050dacf1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:09.467169 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b421f27c-eef7-49ac-b48c-51b050dacf1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:09.467654 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b421f27c-eef7-49ac-b48c-51b050dacf1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:09.468080 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b421f27c-eef7-49ac-b48c-51b050dacf1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:09.628371 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-b421f27c-eef7-49ac-b48c-51b050dacf1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:09.636561 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-b421f27c-eef7-49ac-b48c-51b050dacf1e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.186915 Sep 05 12:31:09.637854 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 124/255] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:09 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:09.753132 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-242b5827-aa7c-4180-a925-8087eb297122 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:09.754481 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-242b5827-aa7c-4180-a925-8087eb297122 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:09.761752 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-242b5827-aa7c-4180-a925-8087eb297122 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:09.762577 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-242b5827-aa7c-4180-a925-8087eb297122 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:09.763224 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-242b5827-aa7c-4180-a925-8087eb297122 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:09.764408 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-242b5827-aa7c-4180-a925-8087eb297122 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:09.765228 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-242b5827-aa7c-4180-a925-8087eb297122 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:09.765892 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-242b5827-aa7c-4180-a925-8087eb297122 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:09.852622 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-242b5827-aa7c-4180-a925-8087eb297122 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:09.860832 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-242b5827-aa7c-4180-a925-8087eb297122 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1218 microversion: 2.1 time: 0.114570 Sep 05 12:31:09.861778 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 132/256] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:09 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:10.666812 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0c5942f4-c852-41cb-8540-e639c4e1e0ee tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:10.667423 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0c5942f4-c852-41cb-8540-e639c4e1e0ee tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:10.674025 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c5942f4-c852-41cb-8540-e639c4e1e0ee tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:10.674418 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c5942f4-c852-41cb-8540-e639c4e1e0ee tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:10.674853 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c5942f4-c852-41cb-8540-e639c4e1e0ee tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:10.675577 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c5942f4-c852-41cb-8540-e639c4e1e0ee tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:10.676029 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c5942f4-c852-41cb-8540-e639c4e1e0ee tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:10.676450 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c5942f4-c852-41cb-8540-e639c4e1e0ee tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:10.836477 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0c5942f4-c852-41cb-8540-e639c4e1e0ee tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:10.845057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0c5942f4-c852-41cb-8540-e639c4e1e0ee tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.181989 Sep 05 12:31:10.852160 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 125/257] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:10 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:10.885147 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-99b29cf1-4235-4eb2-a862-087693294854 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:10.886613 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-99b29cf1-4235-4eb2-a862-087693294854 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:10.914070 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-99b29cf1-4235-4eb2-a862-087693294854 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:10.914670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-99b29cf1-4235-4eb2-a862-087693294854 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:10.916688 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-99b29cf1-4235-4eb2-a862-087693294854 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:10.917560 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-99b29cf1-4235-4eb2-a862-087693294854 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:10.920608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-99b29cf1-4235-4eb2-a862-087693294854 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:10.921153 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-99b29cf1-4235-4eb2-a862-087693294854 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:11.016148 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-99b29cf1-4235-4eb2-a862-087693294854 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:11.026332 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-99b29cf1-4235-4eb2-a862-087693294854 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1266 microversion: 2.1 time: 0.145203 Sep 05 12:31:11.033548 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 133/258] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:10 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:11.871233 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1e4c73e4-6915-45ee-9e1f-221e4527c0e7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:11.871233 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1e4c73e4-6915-45ee-9e1f-221e4527c0e7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:11.881149 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1e4c73e4-6915-45ee-9e1f-221e4527c0e7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:11.881707 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1e4c73e4-6915-45ee-9e1f-221e4527c0e7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:11.882098 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1e4c73e4-6915-45ee-9e1f-221e4527c0e7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:11.884288 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1e4c73e4-6915-45ee-9e1f-221e4527c0e7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:11.886309 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1e4c73e4-6915-45ee-9e1f-221e4527c0e7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:11.887209 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1e4c73e4-6915-45ee-9e1f-221e4527c0e7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:11.966327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-63b5c084-c2bb-4db9-823e-a46572d8e3c3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:11.966925 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-63b5c084-c2bb-4db9-823e-a46572d8e3c3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:11.985496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-63b5c084-c2bb-4db9-823e-a46572d8e3c3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:11.992341 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-63b5c084-c2bb-4db9-823e-a46572d8e3c3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:11.994164 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-63b5c084-c2bb-4db9-823e-a46572d8e3c3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:12.001657 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-63b5c084-c2bb-4db9-823e-a46572d8e3c3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:12.002226 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-63b5c084-c2bb-4db9-823e-a46572d8e3c3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:12.002664 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-63b5c084-c2bb-4db9-823e-a46572d8e3c3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:12.073318 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-63b5c084-c2bb-4db9-823e-a46572d8e3c3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/ips" status: 200 len: 151 microversion: 2.20 time: 0.112779 Sep 05 12:31:12.084324 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 134/259] 10.222.0.62 () {60 vars in 1289 bytes} [Mon Sep 5 12:31:11 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/ips => generated 151 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:31:12.089215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-143059f2-c100-478e-ae35-19ebe2ee0b1c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:12.089825 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-143059f2-c100-478e-ae35-19ebe2ee0b1c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:12.148639 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-143059f2-c100-478e-ae35-19ebe2ee0b1c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:12.151563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-143059f2-c100-478e-ae35-19ebe2ee0b1c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:12.152206 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-143059f2-c100-478e-ae35-19ebe2ee0b1c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:12.156234 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-143059f2-c100-478e-ae35-19ebe2ee0b1c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:12.164070 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-143059f2-c100-478e-ae35-19ebe2ee0b1c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:12.173074 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-143059f2-c100-478e-ae35-19ebe2ee0b1c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:12.282207 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1e4c73e4-6915-45ee-9e1f-221e4527c0e7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:12.283973 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-143059f2-c100-478e-ae35-19ebe2ee0b1c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:12.286621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:12.293327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-143059f2-c100-478e-ae35-19ebe2ee0b1c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1274 microversion: 2.1 time: 0.206585 Sep 05 12:31:12.293973 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1e4c73e4-6915-45ee-9e1f-221e4527c0e7 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.428211 Sep 05 12:31:12.294113 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 135/260] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:12 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1274 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:12.294404 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 126/261] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:11 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:12.314020 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-333c7c6a-da6e-481b-9f8e-8a7c7f6a8f12 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2274afe0-3d30-4240-85b8-3980bb61b404"}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:31:12.318579 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-333c7c6a-da6e-481b-9f8e-8a7c7f6a8f12 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:12.325401 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-333c7c6a-da6e-481b-9f8e-8a7c7f6a8f12 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:12.326138 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-333c7c6a-da6e-481b-9f8e-8a7c7f6a8f12 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:12.326707 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-333c7c6a-da6e-481b-9f8e-8a7c7f6a8f12 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:12.327976 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-333c7c6a-da6e-481b-9f8e-8a7c7f6a8f12 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:12.329399 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-333c7c6a-da6e-481b-9f8e-8a7c7f6a8f12 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:12.330024 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-333c7c6a-da6e-481b-9f8e-8a7c7f6a8f12 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:13.315466 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-64599970-495d-4252-8231-3eb80ca9da74 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:13.316495 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-64599970-495d-4252-8231-3eb80ca9da74 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:13.323360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-64599970-495d-4252-8231-3eb80ca9da74 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:13.324139 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-64599970-495d-4252-8231-3eb80ca9da74 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:13.327364 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-64599970-495d-4252-8231-3eb80ca9da74 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:13.327364 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-64599970-495d-4252-8231-3eb80ca9da74 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:13.327364 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-64599970-495d-4252-8231-3eb80ca9da74 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:13.327364 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-64599970-495d-4252-8231-3eb80ca9da74 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:13.640442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-64599970-495d-4252-8231-3eb80ca9da74 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:13.653874 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-64599970-495d-4252-8231-3eb80ca9da74 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.342188 Sep 05 12:31:13.668810 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 127/262] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:13 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:13.690440 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d30b0e71-b1a3-4300-b986-19a18ab3d3e2 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:13.694156 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d30b0e71-b1a3-4300-b986-19a18ab3d3e2 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:13.713811 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d30b0e71-b1a3-4300-b986-19a18ab3d3e2 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:13.716222 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d30b0e71-b1a3-4300-b986-19a18ab3d3e2 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:13.717178 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d30b0e71-b1a3-4300-b986-19a18ab3d3e2 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:13.719503 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d30b0e71-b1a3-4300-b986-19a18ab3d3e2 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:13.722814 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d30b0e71-b1a3-4300-b986-19a18ab3d3e2 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:13.723473 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d30b0e71-b1a3-4300-b986-19a18ab3d3e2 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:13.915044 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d30b0e71-b1a3-4300-b986-19a18ab3d3e2 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:13.927685 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d30b0e71-b1a3-4300-b986-19a18ab3d3e2 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1314 microversion: 2.1 time: 0.253972 Sep 05 12:31:13.942681 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 128/263] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:13 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:14.217347 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-333c7c6a-da6e-481b-9f8e-8a7c7f6a8f12 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "POST /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.922910 Sep 05 12:31:14.224278 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 136/264] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Sep 5 12:31:12 2022] POST /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/os-volume_attachments => generated 194 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:31:14.456485 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-ac897ce6-9733-46be-adfb-c04333083e10 req-505695f2-64a5-41eb-a334-9e4ab5652a94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57cc6b84-25f0-45bc-9947-d348ed26463a", "tag": "ed9f84cc-e853-45d8-af65-689cc068ec82"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:31:14.485317 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-ac897ce6-9733-46be-adfb-c04333083e10 req-505695f2-64a5-41eb-a334-9e4ab5652a94 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:14.486195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-ac897ce6-9733-46be-adfb-c04333083e10 req-505695f2-64a5-41eb-a334-9e4ab5652a94 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:14.486764 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-ac897ce6-9733-46be-adfb-c04333083e10 req-505695f2-64a5-41eb-a334-9e4ab5652a94 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:14.510376 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-ac897ce6-9733-46be-adfb-c04333083e10 req-505695f2-64a5-41eb-a334-9e4ab5652a94 service nova] Creating event network-changed:ed9f84cc-e853-45d8-af65-689cc068ec82 for instance 57cc6b84-25f0-45bc-9947-d348ed26463a on hv-cinder-80135 Sep 05 12:31:14.517606 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-ac897ce6-9733-46be-adfb-c04333083e10 req-505695f2-64a5-41eb-a334-9e4ab5652a94 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064444 Sep 05 12:31:14.520204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 129/265] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:31:14.691077 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1059946a-6789-4f1f-ba9c-a4d183722692 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:14.693894 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1059946a-6789-4f1f-ba9c-a4d183722692 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:14.715617 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1059946a-6789-4f1f-ba9c-a4d183722692 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:14.717150 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1059946a-6789-4f1f-ba9c-a4d183722692 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:14.719035 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1059946a-6789-4f1f-ba9c-a4d183722692 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:14.720708 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1059946a-6789-4f1f-ba9c-a4d183722692 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:14.721767 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1059946a-6789-4f1f-ba9c-a4d183722692 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:14.723470 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1059946a-6789-4f1f-ba9c-a4d183722692 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:14.950343 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0915abd9-2c72-431d-b779-0722490a95d9 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:14.952360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0915abd9-2c72-431d-b779-0722490a95d9 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:14.965854 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0915abd9-2c72-431d-b779-0722490a95d9 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:14.968917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0915abd9-2c72-431d-b779-0722490a95d9 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:14.968917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0915abd9-2c72-431d-b779-0722490a95d9 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:14.968917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0915abd9-2c72-431d-b779-0722490a95d9 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:14.968917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0915abd9-2c72-431d-b779-0722490a95d9 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:14.969224 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0915abd9-2c72-431d-b779-0722490a95d9 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:15.023638 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1059946a-6789-4f1f-ba9c-a4d183722692 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:15.031794 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1059946a-6789-4f1f-ba9c-a4d183722692 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.350050 Sep 05 12:31:15.032436 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 137/266] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:14 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:15.144796 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0915abd9-2c72-431d-b779-0722490a95d9 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:15.152903 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0915abd9-2c72-431d-b779-0722490a95d9 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1314 microversion: 2.1 time: 0.206966 Sep 05 12:31:15.153494 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 130/267] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:14 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:16.058898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-b594f92b-ed01-4e22-bf58-af7dbae5e9e9 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:16.059801 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-b594f92b-ed01-4e22-bf58-af7dbae5e9e9 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:16.066735 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b594f92b-ed01-4e22-bf58-af7dbae5e9e9 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:16.067751 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b594f92b-ed01-4e22-bf58-af7dbae5e9e9 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:16.068539 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b594f92b-ed01-4e22-bf58-af7dbae5e9e9 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:16.069457 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b594f92b-ed01-4e22-bf58-af7dbae5e9e9 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:16.070128 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b594f92b-ed01-4e22-bf58-af7dbae5e9e9 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:16.071022 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b594f92b-ed01-4e22-bf58-af7dbae5e9e9 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:16.175747 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d35b3185-88b9-4850-ba1a-7639ce61f19f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:16.176377 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d35b3185-88b9-4850-ba1a-7639ce61f19f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:16.179578 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=2 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:16.192231 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d35b3185-88b9-4850-ba1a-7639ce61f19f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:16.192735 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d35b3185-88b9-4850-ba1a-7639ce61f19f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:16.194033 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d35b3185-88b9-4850-ba1a-7639ce61f19f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:16.195000 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d35b3185-88b9-4850-ba1a-7639ce61f19f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:16.195560 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d35b3185-88b9-4850-ba1a-7639ce61f19f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:16.196394 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d35b3185-88b9-4850-ba1a-7639ce61f19f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:16.243821 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-b594f92b-ed01-4e22-bf58-af7dbae5e9e9 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:16.252943 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-b594f92b-ed01-4e22-bf58-af7dbae5e9e9 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.198199 Sep 05 12:31:16.253540 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 138/268] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:16 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:16.365047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d35b3185-88b9-4850-ba1a-7639ce61f19f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:16.377977 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d35b3185-88b9-4850-ba1a-7639ce61f19f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1314 microversion: 2.1 time: 0.206382 Sep 05 12:31:16.378698 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 131/269] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:16 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:16.435092 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-5b38729e-87bd-4406-9071-dbd55d33dd9a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:31:16.435774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-5b38729e-87bd-4406-9071-dbd55d33dd9a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:16.437897 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=2 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:16.442819 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5b38729e-87bd-4406-9071-dbd55d33dd9a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:16.444058 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5b38729e-87bd-4406-9071-dbd55d33dd9a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:16.444486 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5b38729e-87bd-4406-9071-dbd55d33dd9a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:16.445261 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5b38729e-87bd-4406-9071-dbd55d33dd9a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:16.445773 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5b38729e-87bd-4406-9071-dbd55d33dd9a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:16.446191 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5b38729e-87bd-4406-9071-dbd55d33dd9a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:16.463911 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:16.470751 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-5b38729e-87bd-4406-9071-dbd55d33dd9a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lazy-loading 'flavor' on Instance uuid a0105c66-6939-4b6d-b774-c1821012c1f0 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:31:17.194068 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-5b38729e-87bd-4406-9071-dbd55d33dd9a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "POST /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/action" status: 202 len: 0 microversion: 2.20 time: 0.762576 Sep 05 12:31:17.194759 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 139/270] 10.222.0.62 () {62 vars in 1319 bytes} [Mon Sep 5 12:31:16 2022] POST /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/action => generated 0 bytes in 765 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:31:17.203203 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3b463462-7b90-4e9a-a565-4db79b64ee10 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:17.203850 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-3b463462-7b90-4e9a-a565-4db79b64ee10 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:17.210752 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3b463462-7b90-4e9a-a565-4db79b64ee10 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:17.211236 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3b463462-7b90-4e9a-a565-4db79b64ee10 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:17.211718 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3b463462-7b90-4e9a-a565-4db79b64ee10 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:17.212412 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3b463462-7b90-4e9a-a565-4db79b64ee10 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:17.212866 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3b463462-7b90-4e9a-a565-4db79b64ee10 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:17.213302 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3b463462-7b90-4e9a-a565-4db79b64ee10 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:17.284542 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-c0bb6480-c2ee-4ce4-9cd3-76e9311d864b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:17.285616 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-c0bb6480-c2ee-4ce4-9cd3-76e9311d864b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:17.292246 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c0bb6480-c2ee-4ce4-9cd3-76e9311d864b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:17.292826 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c0bb6480-c2ee-4ce4-9cd3-76e9311d864b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:17.293329 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c0bb6480-c2ee-4ce4-9cd3-76e9311d864b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:17.294079 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c0bb6480-c2ee-4ce4-9cd3-76e9311d864b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:17.294595 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c0bb6480-c2ee-4ce4-9cd3-76e9311d864b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:17.295157 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c0bb6480-c2ee-4ce4-9cd3-76e9311d864b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:17.357170 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3b463462-7b90-4e9a-a565-4db79b64ee10 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:17.368587 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3b463462-7b90-4e9a-a565-4db79b64ee10 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:17.370965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3b463462-7b90-4e9a-a565-4db79b64ee10 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:17.373027 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3b463462-7b90-4e9a-a565-4db79b64ee10 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1722 microversion: 2.20 time: 0.173470 Sep 05 12:31:17.374208 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 132/271] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:17 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:17.401655 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-71055a92-3595-4f9d-a763-d3a4f03c054d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:17.402279 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-71055a92-3595-4f9d-a763-d3a4f03c054d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:17.408687 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-71055a92-3595-4f9d-a763-d3a4f03c054d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:17.409485 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-71055a92-3595-4f9d-a763-d3a4f03c054d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:17.410118 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-71055a92-3595-4f9d-a763-d3a4f03c054d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:17.411807 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-71055a92-3595-4f9d-a763-d3a4f03c054d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:17.412275 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-71055a92-3595-4f9d-a763-d3a4f03c054d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:17.412705 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-71055a92-3595-4f9d-a763-d3a4f03c054d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:17.453139 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c0bb6480-c2ee-4ce4-9cd3-76e9311d864b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:17.461957 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-c0bb6480-c2ee-4ce4-9cd3-76e9311d864b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.181949 Sep 05 12:31:17.462576 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 140/272] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:17 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:17.558406 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-71055a92-3595-4f9d-a763-d3a4f03c054d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:17.566523 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-71055a92-3595-4f9d-a763-d3a4f03c054d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1314 microversion: 2.1 time: 0.168806 Sep 05 12:31:17.567116 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 133/273] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:17 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:18.400468 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-dfa409d8-4ef9-4513-9cf6-181ec958715c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:18.401108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-dfa409d8-4ef9-4513-9cf6-181ec958715c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:18.408754 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-dfa409d8-4ef9-4513-9cf6-181ec958715c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:18.409228 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-dfa409d8-4ef9-4513-9cf6-181ec958715c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:18.409653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-dfa409d8-4ef9-4513-9cf6-181ec958715c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:18.410344 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-dfa409d8-4ef9-4513-9cf6-181ec958715c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:18.410792 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-dfa409d8-4ef9-4513-9cf6-181ec958715c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:18.411237 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-dfa409d8-4ef9-4513-9cf6-181ec958715c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:18.497648 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c11775d3-1047-4f25-9137-7a7e0a32128a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:18.498817 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-c11775d3-1047-4f25-9137-7a7e0a32128a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:18.501548 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=10 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:18.503141 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:18.508572 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c11775d3-1047-4f25-9137-7a7e0a32128a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:18.509129 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c11775d3-1047-4f25-9137-7a7e0a32128a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:18.509563 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c11775d3-1047-4f25-9137-7a7e0a32128a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:18.510264 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c11775d3-1047-4f25-9137-7a7e0a32128a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:18.510714 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c11775d3-1047-4f25-9137-7a7e0a32128a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:18.511384 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c11775d3-1047-4f25-9137-7a7e0a32128a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:18.548535 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-dfa409d8-4ef9-4513-9cf6-181ec958715c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:18.557267 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-dfa409d8-4ef9-4513-9cf6-181ec958715c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:18.558720 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-dfa409d8-4ef9-4513-9cf6-181ec958715c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:18.559959 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-dfa409d8-4ef9-4513-9cf6-181ec958715c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1722 microversion: 2.20 time: 0.163507 Sep 05 12:31:18.560517 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 141/274] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:18 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:18.590552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-fcfb3a56-b1d5-45e7-a9e0-e3d1263154bc tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:18.591337 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-fcfb3a56-b1d5-45e7-a9e0-e3d1263154bc tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:18.597592 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fcfb3a56-b1d5-45e7-a9e0-e3d1263154bc tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:18.598081 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fcfb3a56-b1d5-45e7-a9e0-e3d1263154bc tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:18.598513 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fcfb3a56-b1d5-45e7-a9e0-e3d1263154bc tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:18.599742 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fcfb3a56-b1d5-45e7-a9e0-e3d1263154bc tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:18.600201 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fcfb3a56-b1d5-45e7-a9e0-e3d1263154bc tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:18.600621 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fcfb3a56-b1d5-45e7-a9e0-e3d1263154bc tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:18.654701 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c11775d3-1047-4f25-9137-7a7e0a32128a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:18.663744 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-c11775d3-1047-4f25-9137-7a7e0a32128a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.170522 Sep 05 12:31:18.664587 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 134/275] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:18 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:18.735606 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-fcfb3a56-b1d5-45e7-a9e0-e3d1263154bc tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:18.743345 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-fcfb3a56-b1d5-45e7-a9e0-e3d1263154bc tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1314 microversion: 2.1 time: 0.156692 Sep 05 12:31:18.743942 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 142/276] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:18 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:19.587774 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-5dc06291-c65c-4d40-90f3-baba3695fa88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:19.588366 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-5dc06291-c65c-4d40-90f3-baba3695fa88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:19.595512 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5dc06291-c65c-4d40-90f3-baba3695fa88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:19.596028 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5dc06291-c65c-4d40-90f3-baba3695fa88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:19.596457 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5dc06291-c65c-4d40-90f3-baba3695fa88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:19.597151 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5dc06291-c65c-4d40-90f3-baba3695fa88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:19.597599 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5dc06291-c65c-4d40-90f3-baba3695fa88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:19.598015 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5dc06291-c65c-4d40-90f3-baba3695fa88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:19.686644 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-c6f75140-dbdd-4e44-ad36-b3d23c784170 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:19.687243 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-c6f75140-dbdd-4e44-ad36-b3d23c784170 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:19.694173 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c6f75140-dbdd-4e44-ad36-b3d23c784170 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:19.694648 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c6f75140-dbdd-4e44-ad36-b3d23c784170 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:19.695071 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c6f75140-dbdd-4e44-ad36-b3d23c784170 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:19.695784 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c6f75140-dbdd-4e44-ad36-b3d23c784170 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:19.696282 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c6f75140-dbdd-4e44-ad36-b3d23c784170 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:19.696646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c6f75140-dbdd-4e44-ad36-b3d23c784170 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:19.735091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5dc06291-c65c-4d40-90f3-baba3695fa88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:19.744021 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5dc06291-c65c-4d40-90f3-baba3695fa88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:19.745628 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5dc06291-c65c-4d40-90f3-baba3695fa88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:19.746884 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-5dc06291-c65c-4d40-90f3-baba3695fa88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1722 microversion: 2.20 time: 0.164499 Sep 05 12:31:19.747454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 135/277] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:19 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:19.776138 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d34a6149-1856-45de-ab10-4e945ddcf0be tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:19.776943 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d34a6149-1856-45de-ab10-4e945ddcf0be tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:19.784076 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d34a6149-1856-45de-ab10-4e945ddcf0be tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:19.784943 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d34a6149-1856-45de-ab10-4e945ddcf0be tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:19.785489 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d34a6149-1856-45de-ab10-4e945ddcf0be tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:19.786276 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d34a6149-1856-45de-ab10-4e945ddcf0be tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:19.787448 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d34a6149-1856-45de-ab10-4e945ddcf0be tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:19.788168 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d34a6149-1856-45de-ab10-4e945ddcf0be tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:20.026525 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c6f75140-dbdd-4e44-ad36-b3d23c784170 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:20.060362 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-c6f75140-dbdd-4e44-ad36-b3d23c784170 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.377407 Sep 05 12:31:20.065524 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 143/278] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:19 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:20.127578 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d34a6149-1856-45de-ab10-4e945ddcf0be tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:20.136214 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d34a6149-1856-45de-ab10-4e945ddcf0be tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1314 microversion: 2.1 time: 0.374522 Sep 05 12:31:20.140120 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 136/279] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:19 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:20.773988 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-631296ef-6afc-4b47-b30d-3c74f0f0e02a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:20.774586 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-631296ef-6afc-4b47-b30d-3c74f0f0e02a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:20.781286 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-631296ef-6afc-4b47-b30d-3c74f0f0e02a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:20.781768 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-631296ef-6afc-4b47-b30d-3c74f0f0e02a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:20.782198 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-631296ef-6afc-4b47-b30d-3c74f0f0e02a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:20.782889 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-631296ef-6afc-4b47-b30d-3c74f0f0e02a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:20.783343 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-631296ef-6afc-4b47-b30d-3c74f0f0e02a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:20.783799 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-631296ef-6afc-4b47-b30d-3c74f0f0e02a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:20.918339 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-631296ef-6afc-4b47-b30d-3c74f0f0e02a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:20.930394 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-631296ef-6afc-4b47-b30d-3c74f0f0e02a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:20.932909 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-631296ef-6afc-4b47-b30d-3c74f0f0e02a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:20.934294 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-631296ef-6afc-4b47-b30d-3c74f0f0e02a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1722 microversion: 2.20 time: 0.165169 Sep 05 12:31:20.934849 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 144/280] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:20 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:21.084997 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-358eb6c2-af78-4328-9ec6-1cacc5ecdcec tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:21.085610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-358eb6c2-af78-4328-9ec6-1cacc5ecdcec tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:21.101401 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-358eb6c2-af78-4328-9ec6-1cacc5ecdcec tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:21.102342 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-358eb6c2-af78-4328-9ec6-1cacc5ecdcec tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:21.104638 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-358eb6c2-af78-4328-9ec6-1cacc5ecdcec tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:21.105990 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-358eb6c2-af78-4328-9ec6-1cacc5ecdcec tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:21.106680 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-358eb6c2-af78-4328-9ec6-1cacc5ecdcec tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:21.107480 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-358eb6c2-af78-4328-9ec6-1cacc5ecdcec tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:21.179113 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e98644e9-9ece-46e3-912e-7c2ac3207c21 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:21.179765 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-e98644e9-9ece-46e3-912e-7c2ac3207c21 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:21.188177 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e98644e9-9ece-46e3-912e-7c2ac3207c21 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:21.190627 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e98644e9-9ece-46e3-912e-7c2ac3207c21 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:21.191229 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e98644e9-9ece-46e3-912e-7c2ac3207c21 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:21.194511 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e98644e9-9ece-46e3-912e-7c2ac3207c21 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:21.194988 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e98644e9-9ece-46e3-912e-7c2ac3207c21 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:21.195417 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e98644e9-9ece-46e3-912e-7c2ac3207c21 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:21.297903 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-358eb6c2-af78-4328-9ec6-1cacc5ecdcec tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:21.306866 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-358eb6c2-af78-4328-9ec6-1cacc5ecdcec tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.225538 Sep 05 12:31:21.308139 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 137/281] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:21 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:21.368139 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-e98644e9-9ece-46e3-912e-7c2ac3207c21 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:21.376569 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-e98644e9-9ece-46e3-912e-7c2ac3207c21 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1314 microversion: 2.1 time: 0.201863 Sep 05 12:31:21.376769 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 145/282] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:21 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:21.962097 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-fe9b66b3-34c4-40cb-aa0c-831e5c480c22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:21.963188 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-fe9b66b3-34c4-40cb-aa0c-831e5c480c22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:21.969481 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fe9b66b3-34c4-40cb-aa0c-831e5c480c22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:21.969963 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fe9b66b3-34c4-40cb-aa0c-831e5c480c22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:21.970399 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fe9b66b3-34c4-40cb-aa0c-831e5c480c22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:21.971102 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fe9b66b3-34c4-40cb-aa0c-831e5c480c22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:21.971569 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fe9b66b3-34c4-40cb-aa0c-831e5c480c22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:21.973695 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fe9b66b3-34c4-40cb-aa0c-831e5c480c22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:22.127929 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-fe9b66b3-34c4-40cb-aa0c-831e5c480c22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:22.148189 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-fe9b66b3-34c4-40cb-aa0c-831e5c480c22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:22.148189 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-fe9b66b3-34c4-40cb-aa0c-831e5c480c22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:22.148189 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-fe9b66b3-34c4-40cb-aa0c-831e5c480c22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1722 microversion: 2.20 time: 0.186702 Sep 05 12:31:22.148427 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 138/283] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:21 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:22.330327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a0d9fb05-0635-4dd1-b973-ba8f3bcfadeb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:22.331192 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a0d9fb05-0635-4dd1-b973-ba8f3bcfadeb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:22.338478 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a0d9fb05-0635-4dd1-b973-ba8f3bcfadeb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:22.338966 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a0d9fb05-0635-4dd1-b973-ba8f3bcfadeb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:22.339391 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a0d9fb05-0635-4dd1-b973-ba8f3bcfadeb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:22.340167 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a0d9fb05-0635-4dd1-b973-ba8f3bcfadeb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:22.340672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a0d9fb05-0635-4dd1-b973-ba8f3bcfadeb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:22.341120 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a0d9fb05-0635-4dd1-b973-ba8f3bcfadeb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:22.400358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-837b1e69-d6b5-40b5-827b-6973bed779d9 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:22.401075 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-837b1e69-d6b5-40b5-827b-6973bed779d9 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:22.407147 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-837b1e69-d6b5-40b5-827b-6973bed779d9 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:22.407678 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-837b1e69-d6b5-40b5-827b-6973bed779d9 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:22.408115 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-837b1e69-d6b5-40b5-827b-6973bed779d9 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:22.408818 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-837b1e69-d6b5-40b5-827b-6973bed779d9 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:22.409271 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-837b1e69-d6b5-40b5-827b-6973bed779d9 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:22.409728 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-837b1e69-d6b5-40b5-827b-6973bed779d9 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:22.480631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a0d9fb05-0635-4dd1-b973-ba8f3bcfadeb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:22.488819 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a0d9fb05-0635-4dd1-b973-ba8f3bcfadeb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.162245 Sep 05 12:31:22.489487 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 146/284] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:22 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:22.554152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-837b1e69-d6b5-40b5-827b-6973bed779d9 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:22.562382 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-837b1e69-d6b5-40b5-827b-6973bed779d9 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1314 microversion: 2.1 time: 0.166627 Sep 05 12:31:22.562951 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 139/285] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:22 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:23.170210 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-85a9abc3-6ced-4290-a676-b54e3ef51c02 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:23.170922 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-85a9abc3-6ced-4290-a676-b54e3ef51c02 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:23.177114 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-85a9abc3-6ced-4290-a676-b54e3ef51c02 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:23.178156 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-85a9abc3-6ced-4290-a676-b54e3ef51c02 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:23.178608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-85a9abc3-6ced-4290-a676-b54e3ef51c02 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:23.179288 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-85a9abc3-6ced-4290-a676-b54e3ef51c02 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:23.179911 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-85a9abc3-6ced-4290-a676-b54e3ef51c02 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:23.180332 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-85a9abc3-6ced-4290-a676-b54e3ef51c02 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:23.339482 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-85a9abc3-6ced-4290-a676-b54e3ef51c02 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:23.359271 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-85a9abc3-6ced-4290-a676-b54e3ef51c02 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:23.361030 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-85a9abc3-6ced-4290-a676-b54e3ef51c02 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:23.362610 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-85a9abc3-6ced-4290-a676-b54e3ef51c02 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1722 microversion: 2.20 time: 0.196670 Sep 05 12:31:23.363368 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 147/286] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:23 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:23.513950 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a207206f-6569-4163-868e-154930def227 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:23.515230 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a207206f-6569-4163-868e-154930def227 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:23.523063 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a207206f-6569-4163-868e-154930def227 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:23.523589 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a207206f-6569-4163-868e-154930def227 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:23.524025 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a207206f-6569-4163-868e-154930def227 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:23.524745 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a207206f-6569-4163-868e-154930def227 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:23.525198 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a207206f-6569-4163-868e-154930def227 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:23.525625 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a207206f-6569-4163-868e-154930def227 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:23.586981 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-cb36ceb3-5b80-41d8-97ca-600df77e1fa1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:23.587754 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-cb36ceb3-5b80-41d8-97ca-600df77e1fa1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:23.594070 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cb36ceb3-5b80-41d8-97ca-600df77e1fa1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:23.594648 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cb36ceb3-5b80-41d8-97ca-600df77e1fa1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:23.595149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cb36ceb3-5b80-41d8-97ca-600df77e1fa1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:23.595946 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cb36ceb3-5b80-41d8-97ca-600df77e1fa1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:23.596462 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cb36ceb3-5b80-41d8-97ca-600df77e1fa1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:23.596884 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cb36ceb3-5b80-41d8-97ca-600df77e1fa1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:23.668932 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a207206f-6569-4163-868e-154930def227 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:23.677329 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a207206f-6569-4163-868e-154930def227 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.168523 Sep 05 12:31:23.678580 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 140/287] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:23 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:23.779480 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-cb36ceb3-5b80-41d8-97ca-600df77e1fa1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:23.788094 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-cb36ceb3-5b80-41d8-97ca-600df77e1fa1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1314 microversion: 2.1 time: 0.204934 Sep 05 12:31:23.788673 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 148/288] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:23 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:24.389686 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1b466a63-4560-4022-87f9-fc11737fe09f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:24.390434 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1b466a63-4560-4022-87f9-fc11737fe09f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:24.396595 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b466a63-4560-4022-87f9-fc11737fe09f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:24.397140 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b466a63-4560-4022-87f9-fc11737fe09f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:24.397579 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b466a63-4560-4022-87f9-fc11737fe09f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:24.411013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b466a63-4560-4022-87f9-fc11737fe09f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:24.411013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b466a63-4560-4022-87f9-fc11737fe09f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:24.411013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b466a63-4560-4022-87f9-fc11737fe09f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:24.536316 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1b466a63-4560-4022-87f9-fc11737fe09f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:24.545596 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1b466a63-4560-4022-87f9-fc11737fe09f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:24.547060 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1b466a63-4560-4022-87f9-fc11737fe09f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:24.548296 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1b466a63-4560-4022-87f9-fc11737fe09f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1722 microversion: 2.20 time: 0.162544 Sep 05 12:31:24.548853 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 141/289] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:24 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:24.703243 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-15a6d8c7-0faf-40af-a004-78746d0ef2f5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:24.704720 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-15a6d8c7-0faf-40af-a004-78746d0ef2f5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:24.715158 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-15a6d8c7-0faf-40af-a004-78746d0ef2f5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:24.715705 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-15a6d8c7-0faf-40af-a004-78746d0ef2f5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:24.720069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-15a6d8c7-0faf-40af-a004-78746d0ef2f5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:24.720954 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-15a6d8c7-0faf-40af-a004-78746d0ef2f5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:24.721643 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-15a6d8c7-0faf-40af-a004-78746d0ef2f5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:24.722241 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-15a6d8c7-0faf-40af-a004-78746d0ef2f5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:24.813135 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3115e469-ea93-4cfb-a016-76595b536a98 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:24.813972 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-3115e469-ea93-4cfb-a016-76595b536a98 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:24.821856 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3115e469-ea93-4cfb-a016-76595b536a98 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:24.822752 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3115e469-ea93-4cfb-a016-76595b536a98 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:24.823408 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3115e469-ea93-4cfb-a016-76595b536a98 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:24.824853 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3115e469-ea93-4cfb-a016-76595b536a98 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:24.825564 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3115e469-ea93-4cfb-a016-76595b536a98 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:24.826218 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3115e469-ea93-4cfb-a016-76595b536a98 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:24.979647 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-15a6d8c7-0faf-40af-a004-78746d0ef2f5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:24.995493 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-15a6d8c7-0faf-40af-a004-78746d0ef2f5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.298126 Sep 05 12:31:24.996351 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 149/290] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:24 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:25.038848 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3115e469-ea93-4cfb-a016-76595b536a98 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:25.049271 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3115e469-ea93-4cfb-a016-76595b536a98 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1314 microversion: 2.1 time: 0.241663 Sep 05 12:31:25.050136 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 142/291] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:24 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:25.575184 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-367f1fef-cd0e-4ec2-b6a0-e48564992863 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:25.575836 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-367f1fef-cd0e-4ec2-b6a0-e48564992863 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:25.577847 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:25.582580 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-367f1fef-cd0e-4ec2-b6a0-e48564992863 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:25.583058 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-367f1fef-cd0e-4ec2-b6a0-e48564992863 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:25.583491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-367f1fef-cd0e-4ec2-b6a0-e48564992863 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:25.584265 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-367f1fef-cd0e-4ec2-b6a0-e48564992863 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:25.584712 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-367f1fef-cd0e-4ec2-b6a0-e48564992863 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:25.585128 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-367f1fef-cd0e-4ec2-b6a0-e48564992863 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:25.799886 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-367f1fef-cd0e-4ec2-b6a0-e48564992863 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:25.815670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-367f1fef-cd0e-4ec2-b6a0-e48564992863 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:25.816869 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-367f1fef-cd0e-4ec2-b6a0-e48564992863 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:25.818859 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-367f1fef-cd0e-4ec2-b6a0-e48564992863 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1722 microversion: 2.20 time: 0.247261 Sep 05 12:31:25.831178 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 150/292] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:25 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:26.019920 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4b8d7261-87a1-4713-aed3-428a6553622d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:26.020582 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4b8d7261-87a1-4713-aed3-428a6553622d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:26.027168 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4b8d7261-87a1-4713-aed3-428a6553622d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:26.027762 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4b8d7261-87a1-4713-aed3-428a6553622d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:26.028195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4b8d7261-87a1-4713-aed3-428a6553622d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:26.028955 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4b8d7261-87a1-4713-aed3-428a6553622d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:26.029400 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4b8d7261-87a1-4713-aed3-428a6553622d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:26.029819 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4b8d7261-87a1-4713-aed3-428a6553622d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:26.073285 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a17f7fb9-b4b5-42b6-b2ab-5c1c6ef81816 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:26.073973 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a17f7fb9-b4b5-42b6-b2ab-5c1c6ef81816 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:26.081247 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a17f7fb9-b4b5-42b6-b2ab-5c1c6ef81816 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:26.081728 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a17f7fb9-b4b5-42b6-b2ab-5c1c6ef81816 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:26.082154 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a17f7fb9-b4b5-42b6-b2ab-5c1c6ef81816 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:26.082852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a17f7fb9-b4b5-42b6-b2ab-5c1c6ef81816 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:26.083298 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a17f7fb9-b4b5-42b6-b2ab-5c1c6ef81816 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:26.083769 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a17f7fb9-b4b5-42b6-b2ab-5c1c6ef81816 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:26.173006 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-4b8d7261-87a1-4713-aed3-428a6553622d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:26.181894 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4b8d7261-87a1-4713-aed3-428a6553622d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.165992 Sep 05 12:31:26.182595 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 143/293] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:26 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:26.309156 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a17f7fb9-b4b5-42b6-b2ab-5c1c6ef81816 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:26.317757 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a17f7fb9-b4b5-42b6-b2ab-5c1c6ef81816 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1314 microversion: 2.1 time: 0.248129 Sep 05 12:31:26.318394 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 151/294] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:26 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:26.849227 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-f82874c9-cdcf-452a-a36c-31bae12378e2 req-a82c3916-8754-42a1-b468-dbaf628cd646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57cc6b84-25f0-45bc-9947-d348ed26463a", "name": "network-vif-plugged", "status": "completed", "tag": "ed9f84cc-e853-45d8-af65-689cc068ec82"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:31:26.854922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-de58d45e-5764-4b56-b45b-5a0e8173abf2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:26.854922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-de58d45e-5764-4b56-b45b-5a0e8173abf2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:26.859127 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-de58d45e-5764-4b56-b45b-5a0e8173abf2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:26.859772 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-de58d45e-5764-4b56-b45b-5a0e8173abf2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:26.861609 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-de58d45e-5764-4b56-b45b-5a0e8173abf2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:26.862480 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-de58d45e-5764-4b56-b45b-5a0e8173abf2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:26.863045 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-de58d45e-5764-4b56-b45b-5a0e8173abf2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:26.863690 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-de58d45e-5764-4b56-b45b-5a0e8173abf2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:26.868503 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=100 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:26.870021 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-f82874c9-cdcf-452a-a36c-31bae12378e2 req-a82c3916-8754-42a1-b468-dbaf628cd646 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:26.872169 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-f82874c9-cdcf-452a-a36c-31bae12378e2 req-a82c3916-8754-42a1-b468-dbaf628cd646 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:26.873255 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-f82874c9-cdcf-452a-a36c-31bae12378e2 req-a82c3916-8754-42a1-b468-dbaf628cd646 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:26.907887 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-f82874c9-cdcf-452a-a36c-31bae12378e2 req-a82c3916-8754-42a1-b468-dbaf628cd646 service nova] Creating event network-vif-plugged:ed9f84cc-e853-45d8-af65-689cc068ec82 for instance 57cc6b84-25f0-45bc-9947-d348ed26463a on hv-cinder-80135 Sep 05 12:31:26.907887 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-f82874c9-cdcf-452a-a36c-31bae12378e2 req-a82c3916-8754-42a1-b468-dbaf628cd646 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058900 Sep 05 12:31:26.911925 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 152/295] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:31:27.026939 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-de58d45e-5764-4b56-b45b-5a0e8173abf2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:27.035976 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-de58d45e-5764-4b56-b45b-5a0e8173abf2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:27.038145 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-de58d45e-5764-4b56-b45b-5a0e8173abf2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:27.038881 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-de58d45e-5764-4b56-b45b-5a0e8173abf2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1722 microversion: 2.20 time: 0.195630 Sep 05 12:31:27.039523 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 144/296] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:26 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:27.210721 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-85450c19-0e9b-406e-8bd7-32ce3e4b2aec tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:27.211785 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-85450c19-0e9b-406e-8bd7-32ce3e4b2aec tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:27.219097 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-85450c19-0e9b-406e-8bd7-32ce3e4b2aec tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:27.219616 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-85450c19-0e9b-406e-8bd7-32ce3e4b2aec tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:27.220052 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-85450c19-0e9b-406e-8bd7-32ce3e4b2aec tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:27.220764 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-85450c19-0e9b-406e-8bd7-32ce3e4b2aec tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:27.221281 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-85450c19-0e9b-406e-8bd7-32ce3e4b2aec tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:27.222037 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-85450c19-0e9b-406e-8bd7-32ce3e4b2aec tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:27.346309 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e77a0bc6-699e-4420-ae72-9e2665c7b9d5 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:27.347098 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e77a0bc6-699e-4420-ae72-9e2665c7b9d5 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:27.357809 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e77a0bc6-699e-4420-ae72-9e2665c7b9d5 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:27.358297 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e77a0bc6-699e-4420-ae72-9e2665c7b9d5 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:27.358729 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e77a0bc6-699e-4420-ae72-9e2665c7b9d5 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:27.359456 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e77a0bc6-699e-4420-ae72-9e2665c7b9d5 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:27.359934 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e77a0bc6-699e-4420-ae72-9e2665c7b9d5 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:27.360543 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e77a0bc6-699e-4420-ae72-9e2665c7b9d5 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:27.363451 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-85450c19-0e9b-406e-8bd7-32ce3e4b2aec tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:27.373053 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-85450c19-0e9b-406e-8bd7-32ce3e4b2aec tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.166601 Sep 05 12:31:27.384104 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 153/297] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:27 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:27.524941 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e77a0bc6-699e-4420-ae72-9e2665c7b9d5 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:27.532891 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e77a0bc6-699e-4420-ae72-9e2665c7b9d5 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1314 microversion: 2.1 time: 0.190441 Sep 05 12:31:27.533470 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 145/298] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:27 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:27.635362 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4aa1b65c-9cf9-4f3c-a3c8-7add76aacb1f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Action: 'create', calling method: .version_select at 0x7fe712a67670>, body: {"keypair": {"name": "tempest-keypair-1255692174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWJ0pfcEvtEHyerq8+s6rUjkKNfdbCBxnxE27Bd8NOgb8QGhSUCtr08aCmytfPI5jGVLs7skrLbTRJz5fYnIKjmiV7/zAAQUR5QQTHGRWqF0cSMWSvNWuBqBhQURlDzew=="}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:31:27.665563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-4aa1b65c-9cf9-4f3c-a3c8-7add76aacb1f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Getting quotas for project 4f6830d2e75a47c8a757d4a66c6695ca. Resources: {'key_pairs'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:31:27.671570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-4aa1b65c-9cf9-4f3c-a3c8-7add76aacb1f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Getting quotas for user de2273220e824339bd13d968c75df26b and project 4f6830d2e75a47c8a757d4a66c6695ca. Resources: {'key_pairs'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:31:27.883834 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-4aa1b65c-9cf9-4f3c-a3c8-7add76aacb1f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.238179 Sep 05 12:31:27.883834 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 154/299] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Sep 5 12:31:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:31:28.066027 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-35613a45-220f-45c7-9de2-83f6377f4f73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:28.067321 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-35613a45-220f-45c7-9de2-83f6377f4f73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:28.075240 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-35613a45-220f-45c7-9de2-83f6377f4f73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:28.075965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-35613a45-220f-45c7-9de2-83f6377f4f73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:28.076511 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-35613a45-220f-45c7-9de2-83f6377f4f73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:28.077525 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-35613a45-220f-45c7-9de2-83f6377f4f73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:28.078342 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-35613a45-220f-45c7-9de2-83f6377f4f73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:28.078865 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-35613a45-220f-45c7-9de2-83f6377f4f73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:28.234389 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-35613a45-220f-45c7-9de2-83f6377f4f73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:28.243740 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-35613a45-220f-45c7-9de2-83f6377f4f73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:28.245255 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-35613a45-220f-45c7-9de2-83f6377f4f73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:28.246466 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-35613a45-220f-45c7-9de2-83f6377f4f73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1722 microversion: 2.20 time: 0.184470 Sep 05 12:31:28.247027 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 146/300] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:28 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:28.397261 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-fcaad237-da4c-480d-b78a-4d0788a7901c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:28.398578 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-fcaad237-da4c-480d-b78a-4d0788a7901c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:28.404921 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fcaad237-da4c-480d-b78a-4d0788a7901c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:28.405454 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fcaad237-da4c-480d-b78a-4d0788a7901c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:28.405864 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fcaad237-da4c-480d-b78a-4d0788a7901c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:28.406571 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fcaad237-da4c-480d-b78a-4d0788a7901c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:28.407137 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fcaad237-da4c-480d-b78a-4d0788a7901c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:28.407449 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fcaad237-da4c-480d-b78a-4d0788a7901c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:28.559139 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-61fb7615-52ad-45a6-9412-a69f5317300d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:28.572035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-61fb7615-52ad-45a6-9412-a69f5317300d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:28.572035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-61fb7615-52ad-45a6-9412-a69f5317300d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:28.572035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-61fb7615-52ad-45a6-9412-a69f5317300d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:28.572035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-61fb7615-52ad-45a6-9412-a69f5317300d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:28.572571 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-61fb7615-52ad-45a6-9412-a69f5317300d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:28.572571 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-61fb7615-52ad-45a6-9412-a69f5317300d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:28.572571 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-61fb7615-52ad-45a6-9412-a69f5317300d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:28.616282 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-fcaad237-da4c-480d-b78a-4d0788a7901c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:28.620071 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:28.629905 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-fcaad237-da4c-480d-b78a-4d0788a7901c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1503 microversion: 2.1 time: 0.234102 Sep 05 12:31:28.629905 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 155/301] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:28 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:28.651344 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-841578b2-df09-4bd6-aa03-5c4925adc80b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1e053a4-182f-4134-b999-f722f48da17e"}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:31:28.654713 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-841578b2-df09-4bd6-aa03-5c4925adc80b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:28.662496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-841578b2-df09-4bd6-aa03-5c4925adc80b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:28.663367 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-841578b2-df09-4bd6-aa03-5c4925adc80b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:28.664163 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-841578b2-df09-4bd6-aa03-5c4925adc80b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:28.665134 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-841578b2-df09-4bd6-aa03-5c4925adc80b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:28.665705 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-841578b2-df09-4bd6-aa03-5c4925adc80b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:28.666237 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-841578b2-df09-4bd6-aa03-5c4925adc80b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:28.694909 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-841578b2-df09-4bd6-aa03-5c4925adc80b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] HTTP exception thrown: Cannot 'attach_volume' instance 83fdb4c3-ab13-406e-8f5c-a8a7e481374f while it is in vm_state rescued Sep 05 12:31:28.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-841578b2-df09-4bd6-aa03-5c4925adc80b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Request method failure captured: Sep 05 12:31:28.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: POST /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f/os-volume_attachments HTTP/1.1 Sep 05 12:31:28.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:31:28.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:31:28.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:31:28.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 74 Sep 05 12:31:28.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:31:28.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:31:28.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:31:28.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:31:28.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFeum8bx5jyveF85UtCG36zw6ZW7Ho89ZdS6sAhd29-DgS8z8mX-sxztHgo8dEEIhPTiA0DvlBnCKqmEaegTdojqUwYbH3yXd1WqKjjFpLp0dzFo0kaeLBSaKV5jpy-kf5GWYU61zSOo9eRrpikFnOvGyJFTC23WpaNWLxZkymGt-fS4 Sep 05 12:31:28.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:31:28.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:31:28.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:31:28.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:31:28.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:31:28.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:31:28.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 442bf64c97d945feb79f64cdd66baa28 Sep 05 12:31:28.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1766995040 Sep 05 12:31:28.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:31:28.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:31:28.699215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/442bf64c97d945feb79f64cdd66baa28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/442bf64c97d945feb79f64cdd66baa28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/442bf64c97d945feb79f64cdd66baa28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_442bf64c97d945feb79f64cdd66baa28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:31:28.699215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1766995040 Sep 05 12:31:28.699215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 442bf64c97d945feb79f64cdd66baa28 Sep 05 12:31:28.699215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1766995040 Sep 05 12:31:28.699215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-ServerRescueNegativeTestJSON-1766995040-project Sep 05 12:31:28.699215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:31:28.699215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:31:28.699215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: f5543fbd902d441cb6f03d3155f1af8d Sep 05 12:31:28.699215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1766995040-project Sep 05 12:31:28.699215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Sep 05 12:31:28.699215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {"volumeAttachment": {"volumeId": "f1e053a4-182f-4134-b999-f722f48da17e"}} Sep 05 12:31:28.699215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:31:28.700048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Cannot 'attach_volume' instance 83fdb4c3-ab13-406e-8f5c-a8a7e481374f while it is in vm_state rescued Sep 05 12:31:28.700048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'server_id': '83fdb4c3-ab13-406e-8f5c-a8a7e481374f', 'body': {'volumeAttachment': {'volumeId': 'f1e053a4-182f-4134-b999-f722f48da17e'}}} Sep 05 12:31:28.700048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:31:28.700048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:31:28.700048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 05 12:31:28.700048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 05 12:31:28.700048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 12:31:28.700048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 12:31:28.700048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 05 12:31:28.700048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 05 12:31:28.700048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 83fdb4c3-ab13-406e-8f5c-a8a7e481374f in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 05 12:31:28.700048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:31:28.700048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:31:28.700048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:31:28.700048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:31:28.700048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:31:28.700048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:31:28.700048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:31:28.700048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:31:28.701269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:31:28.701269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:31:28.701269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 12:31:28.701269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:31:28.701269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 12:31:28.701269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:31:28.701269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 12:31:28.701269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:31:28.701269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 05 12:31:28.701269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 05 12:31:28.701269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 05 12:31:28.701269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 05 12:31:28.701269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 83fdb4c3-ab13-406e-8f5c-a8a7e481374f while it is in vm_state rescued Sep 05 12:31:28.701269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:31:28.701269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:31:28.701269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:31:28.701269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:31:28.701269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:31:28.701269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:31:28.702393 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:31:28.702393 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:31:28.702393 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 83fdb4c3-ab13-406e-8f5c-a8a7e481374f while it is in vm_state rescued Sep 05 12:31:28.702393 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:31:28.702393 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-841578b2-df09-4bd6-aa03-5c4925adc80b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Returning 409 to user: Cannot 'attach_volume' instance 83fdb4c3-ab13-406e-8f5c-a8a7e481374f while it is in vm_state rescued {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:31:28.702393 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-841578b2-df09-4bd6-aa03-5c4925adc80b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "POST /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055741 Sep 05 12:31:28.703777 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 156/302] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Sep 5 12:31:28 2022] POST /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 05 12:31:28.711411 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-9bf4d39c-a579-453d-bfbf-687b8df75107 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:31:28.711966 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-9bf4d39c-a579-453d-bfbf-687b8df75107 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:28.719299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9bf4d39c-a579-453d-bfbf-687b8df75107 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:28.719750 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9bf4d39c-a579-453d-bfbf-687b8df75107 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:28.720186 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9bf4d39c-a579-453d-bfbf-687b8df75107 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:28.720920 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9bf4d39c-a579-453d-bfbf-687b8df75107 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:28.721371 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9bf4d39c-a579-453d-bfbf-687b8df75107 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:28.721789 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9bf4d39c-a579-453d-bfbf-687b8df75107 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:28.800578 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-61fb7615-52ad-45a6-9412-a69f5317300d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:28.813601 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-61fb7615-52ad-45a6-9412-a69f5317300d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1314 microversion: 2.1 time: 0.256969 Sep 05 12:31:28.813601 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 147/303] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:28 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:29.114223 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-9bf4d39c-a579-453d-bfbf-687b8df75107 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "POST /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f/action" status: 202 len: 0 microversion: 2.1 time: 0.401640 Sep 05 12:31:29.114223 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 157/304] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Sep 5 12:31:28 2022] POST /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 05 12:31:29.118870 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0d0fd9e7-4248-4a70-b9dd-fa3b99d5592d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:29.120297 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0d0fd9e7-4248-4a70-b9dd-fa3b99d5592d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:29.126515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0d0fd9e7-4248-4a70-b9dd-fa3b99d5592d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:29.126998 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0d0fd9e7-4248-4a70-b9dd-fa3b99d5592d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:29.127424 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0d0fd9e7-4248-4a70-b9dd-fa3b99d5592d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:29.128158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0d0fd9e7-4248-4a70-b9dd-fa3b99d5592d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:29.128914 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0d0fd9e7-4248-4a70-b9dd-fa3b99d5592d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:29.129340 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0d0fd9e7-4248-4a70-b9dd-fa3b99d5592d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:29.272871 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-cacc6e09-ce97-4e21-8cb0-4466479e136d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:29.273904 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-cacc6e09-ce97-4e21-8cb0-4466479e136d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:29.280044 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0d0fd9e7-4248-4a70-b9dd-fa3b99d5592d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:29.281995 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cacc6e09-ce97-4e21-8cb0-4466479e136d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:29.282571 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cacc6e09-ce97-4e21-8cb0-4466479e136d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:29.283093 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cacc6e09-ce97-4e21-8cb0-4466479e136d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:29.284096 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cacc6e09-ce97-4e21-8cb0-4466479e136d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:29.284641 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cacc6e09-ce97-4e21-8cb0-4466479e136d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:29.285166 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cacc6e09-ce97-4e21-8cb0-4466479e136d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:29.288716 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0d0fd9e7-4248-4a70-b9dd-fa3b99d5592d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1511 microversion: 2.1 time: 0.174544 Sep 05 12:31:29.289300 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 148/305] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:29 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:29.449035 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-cacc6e09-ce97-4e21-8cb0-4466479e136d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:29.457331 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-cacc6e09-ce97-4e21-8cb0-4466479e136d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:29.459290 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-cacc6e09-ce97-4e21-8cb0-4466479e136d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:29.467313 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-cacc6e09-ce97-4e21-8cb0-4466479e136d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1722 microversion: 2.20 time: 0.197836 Sep 05 12:31:29.467313 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 158/306] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:29 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:29.834794 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ba58c8a4-d0b1-4833-9eba-03b351da5ecd tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:29.835919 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ba58c8a4-d0b1-4833-9eba-03b351da5ecd tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:29.843832 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ba58c8a4-d0b1-4833-9eba-03b351da5ecd tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:29.847652 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ba58c8a4-d0b1-4833-9eba-03b351da5ecd tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:29.847652 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ba58c8a4-d0b1-4833-9eba-03b351da5ecd tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:29.848005 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ba58c8a4-d0b1-4833-9eba-03b351da5ecd tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:29.850824 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ba58c8a4-d0b1-4833-9eba-03b351da5ecd tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:29.851371 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ba58c8a4-d0b1-4833-9eba-03b351da5ecd tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:30.056058 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ba58c8a4-d0b1-4833-9eba-03b351da5ecd tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:30.070251 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ba58c8a4-d0b1-4833-9eba-03b351da5ecd tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1314 microversion: 2.1 time: 0.239722 Sep 05 12:31:30.071008 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 149/307] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:29 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:30.313910 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-8239c0ab-93bd-40ef-a020-4adc2717f751 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:30.315029 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-8239c0ab-93bd-40ef-a020-4adc2717f751 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:30.324076 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8239c0ab-93bd-40ef-a020-4adc2717f751 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:30.324575 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8239c0ab-93bd-40ef-a020-4adc2717f751 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:30.325210 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8239c0ab-93bd-40ef-a020-4adc2717f751 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:30.326071 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8239c0ab-93bd-40ef-a020-4adc2717f751 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:30.326535 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8239c0ab-93bd-40ef-a020-4adc2717f751 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:30.326966 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8239c0ab-93bd-40ef-a020-4adc2717f751 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:30.496680 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-da20d9ab-f4a4-401d-9068-7e3b7768fc0e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:30.497853 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-da20d9ab-f4a4-401d-9068-7e3b7768fc0e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:30.513487 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-da20d9ab-f4a4-401d-9068-7e3b7768fc0e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:30.514202 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-da20d9ab-f4a4-401d-9068-7e3b7768fc0e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:30.516133 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-da20d9ab-f4a4-401d-9068-7e3b7768fc0e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:30.518076 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-da20d9ab-f4a4-401d-9068-7e3b7768fc0e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:30.518828 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-da20d9ab-f4a4-401d-9068-7e3b7768fc0e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:30.520040 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-da20d9ab-f4a4-401d-9068-7e3b7768fc0e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:30.574894 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-8239c0ab-93bd-40ef-a020-4adc2717f751 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:30.582916 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-8239c0ab-93bd-40ef-a020-4adc2717f751 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1511 microversion: 2.1 time: 0.273518 Sep 05 12:31:30.583492 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 159/308] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:30 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1511 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:30.883460 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-da20d9ab-f4a4-401d-9068-7e3b7768fc0e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:30.895245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-da20d9ab-f4a4-401d-9068-7e3b7768fc0e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:30.897584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-da20d9ab-f4a4-401d-9068-7e3b7768fc0e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:30.898989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-da20d9ab-f4a4-401d-9068-7e3b7768fc0e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1722 microversion: 2.20 time: 0.406262 Sep 05 12:31:30.909809 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 150/309] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:30 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1722 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:31.098306 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4344bf0c-1da8-422a-91f0-3626fd70b5a6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:31.100134 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-4344bf0c-1da8-422a-91f0-3626fd70b5a6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:31.115763 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4344bf0c-1da8-422a-91f0-3626fd70b5a6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:31.116662 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4344bf0c-1da8-422a-91f0-3626fd70b5a6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:31.117170 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4344bf0c-1da8-422a-91f0-3626fd70b5a6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:31.118074 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4344bf0c-1da8-422a-91f0-3626fd70b5a6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:31.118702 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4344bf0c-1da8-422a-91f0-3626fd70b5a6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:31.119134 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4344bf0c-1da8-422a-91f0-3626fd70b5a6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:31.330301 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-4344bf0c-1da8-422a-91f0-3626fd70b5a6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:31.346236 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-4344bf0c-1da8-422a-91f0-3626fd70b5a6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1497 microversion: 2.1 time: 0.251545 Sep 05 12:31:31.346715 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 160/310] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:31 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1497 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:31.556450 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-286ce3ee-dc43-4cc2-aae1-49bd9e4a4623 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1540405813", "imageRef": "7844cf5b-4975-4cb9-a7f8-31cc5e52098a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7678039b-6ecf-4526-a1ee-cbdc20c4b02b"}], "security_groups": [{"name": "tempest-securitygroup--1649622884"}], "key_name": "tempest-keypair-1255692174", "user_data": "}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:31:31.608166 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-16d3ce51-5cf6-413f-a92e-5a580f25886f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:31.609308 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-16d3ce51-5cf6-413f-a92e-5a580f25886f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:31.634352 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-16d3ce51-5cf6-413f-a92e-5a580f25886f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:31.634352 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-16d3ce51-5cf6-413f-a92e-5a580f25886f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:31.634848 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-16d3ce51-5cf6-413f-a92e-5a580f25886f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:31.641676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-16d3ce51-5cf6-413f-a92e-5a580f25886f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:31.642173 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-16d3ce51-5cf6-413f-a92e-5a580f25886f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:31.642608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-16d3ce51-5cf6-413f-a92e-5a580f25886f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:31.710008 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.network.neutron [None req-286ce3ee-dc43-4cc2-aae1-49bd9e4a4623 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] validate_networks() for [('7678039b-6ecf-4526-a1ee-cbdc20c4b02b', None, None, None, None, None)] {{(pid=121211) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:31:31.822666 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-16d3ce51-5cf6-413f-a92e-5a580f25886f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:31.831275 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-16d3ce51-5cf6-413f-a92e-5a580f25886f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1511 microversion: 2.1 time: 0.228289 Sep 05 12:31:31.831957 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 161/311] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:31 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:31.929235 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-0a48fd9f-625f-428f-b786-360706e15756 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:31.929808 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-0a48fd9f-625f-428f-b786-360706e15756 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:31.936750 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0a48fd9f-625f-428f-b786-360706e15756 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:31.937236 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0a48fd9f-625f-428f-b786-360706e15756 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:31.937661 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0a48fd9f-625f-428f-b786-360706e15756 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:31.938355 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0a48fd9f-625f-428f-b786-360706e15756 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:31.938802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0a48fd9f-625f-428f-b786-360706e15756 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:31.939218 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0a48fd9f-625f-428f-b786-360706e15756 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:32.145085 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-0a48fd9f-625f-428f-b786-360706e15756 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:32.155870 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-0a48fd9f-625f-428f-b786-360706e15756 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:32.157707 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-0a48fd9f-625f-428f-b786-360706e15756 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:32.159226 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-0a48fd9f-625f-428f-b786-360706e15756 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1722 microversion: 2.20 time: 0.237100 Sep 05 12:31:32.160094 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 162/312] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:31 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:31:32.217589 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-286ce3ee-dc43-4cc2-aae1-49bd9e4a4623 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Flavor limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:31:32.218031 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-286ce3ee-dc43-4cc2-aae1-49bd9e4a4623 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Image limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:31:32.225088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-286ce3ee-dc43-4cc2-aae1-49bd9e4a4623 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Flavor pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:31:32.225088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-286ce3ee-dc43-4cc2-aae1-49bd9e4a4623 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Image pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:31:32.225088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-286ce3ee-dc43-4cc2-aae1-49bd9e4a4623 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:31:32.230358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-286ce3ee-dc43-4cc2-aae1-49bd9e4a4623 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:32.230838 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-286ce3ee-dc43-4cc2-aae1-49bd9e4a4623 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:32.231268 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-286ce3ee-dc43-4cc2-aae1-49bd9e4a4623 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:32.233012 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-286ce3ee-dc43-4cc2-aae1-49bd9e4a4623 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:32.233012 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-286ce3ee-dc43-4cc2-aae1-49bd9e4a4623 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:32.233012 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-286ce3ee-dc43-4cc2-aae1-49bd9e4a4623 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:32.253821 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-286ce3ee-dc43-4cc2-aae1-49bd9e4a4623 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Getting quotas for project 4f6830d2e75a47c8a757d4a66c6695ca. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:31:32.258188 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-286ce3ee-dc43-4cc2-aae1-49bd9e4a4623 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Getting quotas for user de2273220e824339bd13d968c75df26b and project 4f6830d2e75a47c8a757d4a66c6695ca. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:31:32.274425 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-286ce3ee-dc43-4cc2-aae1-49bd9e4a4623 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Going to run 1 instances... {{(pid=121211) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:31:32.277066 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-286ce3ee-dc43-4cc2-aae1-49bd9e4a4623 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7844cf5b-4975-4cb9-a7f8-31cc5e52098a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121211) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:31:32.455751 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-286ce3ee-dc43-4cc2-aae1-49bd9e4a4623 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.903500 Sep 05 12:31:32.456446 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 151/313] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Sep 5 12:31:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:31:32.468815 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ed0363ae-7a53-46d2-9e31-5ff73bd45bb1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:32.470175 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-ed0363ae-7a53-46d2-9e31-5ff73bd45bb1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:32.542414 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-ed0363ae-7a53-46d2-9e31-5ff73bd45bb1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:32.555895 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-ed0363ae-7a53-46d2-9e31-5ff73bd45bb1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1242 microversion: 2.1 time: 0.090900 Sep 05 12:31:32.556528 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 163/314] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:32 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:32.867426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-da6a01ae-0aaa-44b8-b4fd-8589b135440f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:32.867975 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-da6a01ae-0aaa-44b8-b4fd-8589b135440f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:32.868354 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-14b9eeea-7d66-4b73-a310-37bfb4b15e33 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:32.870435 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-14b9eeea-7d66-4b73-a310-37bfb4b15e33 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:32.875890 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-da6a01ae-0aaa-44b8-b4fd-8589b135440f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:32.876662 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-da6a01ae-0aaa-44b8-b4fd-8589b135440f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:32.877276 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-da6a01ae-0aaa-44b8-b4fd-8589b135440f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:32.878147 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-da6a01ae-0aaa-44b8-b4fd-8589b135440f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:32.878761 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-da6a01ae-0aaa-44b8-b4fd-8589b135440f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:32.879346 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-da6a01ae-0aaa-44b8-b4fd-8589b135440f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:32.883700 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-14b9eeea-7d66-4b73-a310-37bfb4b15e33 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:32.884203 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-14b9eeea-7d66-4b73-a310-37bfb4b15e33 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:32.884643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-14b9eeea-7d66-4b73-a310-37bfb4b15e33 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:32.888294 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-14b9eeea-7d66-4b73-a310-37bfb4b15e33 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:32.888294 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-14b9eeea-7d66-4b73-a310-37bfb4b15e33 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:32.888294 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-14b9eeea-7d66-4b73-a310-37bfb4b15e33 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:32.932788 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-da6a01ae-0aaa-44b8-b4fd-8589b135440f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Going to try to terminate instance {{(pid=121210) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:31:33.075961 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-14b9eeea-7d66-4b73-a310-37bfb4b15e33 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:33.086727 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-14b9eeea-7d66-4b73-a310-37bfb4b15e33 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1511 microversion: 2.1 time: 0.231014 Sep 05 12:31:33.087690 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 152/315] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:32 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1511 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:33.189039 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-efff8ae8-3243-4505-b8eb-bebbc263643b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:33.190335 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-efff8ae8-3243-4505-b8eb-bebbc263643b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:33.197005 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-efff8ae8-3243-4505-b8eb-bebbc263643b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:33.197496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-efff8ae8-3243-4505-b8eb-bebbc263643b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:33.203747 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-efff8ae8-3243-4505-b8eb-bebbc263643b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:33.203747 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-efff8ae8-3243-4505-b8eb-bebbc263643b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:33.203747 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-efff8ae8-3243-4505-b8eb-bebbc263643b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:33.203747 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-efff8ae8-3243-4505-b8eb-bebbc263643b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:33.363354 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-efff8ae8-3243-4505-b8eb-bebbc263643b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:33.372480 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-efff8ae8-3243-4505-b8eb-bebbc263643b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:33.373973 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-efff8ae8-3243-4505-b8eb-bebbc263643b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:33.375203 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-efff8ae8-3243-4505-b8eb-bebbc263643b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1722 microversion: 2.20 time: 0.190483 Sep 05 12:31:33.386428 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-da6a01ae-0aaa-44b8-b4fd-8589b135440f tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "DELETE /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 204 len: 0 microversion: 2.1 time: 0.517722 Sep 05 12:31:33.386428 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 164/316] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:31:32 2022] DELETE /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:31:33.388230 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 153/317] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:33 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:33.392873 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-f3395b8a-4895-489b-80d0-02f7a140edae tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:33.393575 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-f3395b8a-4895-489b-80d0-02f7a140edae tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:33.401083 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f3395b8a-4895-489b-80d0-02f7a140edae tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:33.401573 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f3395b8a-4895-489b-80d0-02f7a140edae tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:33.402003 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f3395b8a-4895-489b-80d0-02f7a140edae tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:33.402769 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f3395b8a-4895-489b-80d0-02f7a140edae tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:33.403222 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f3395b8a-4895-489b-80d0-02f7a140edae tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:33.403676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f3395b8a-4895-489b-80d0-02f7a140edae tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:33.543365 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f3395b8a-4895-489b-80d0-02f7a140edae tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:33.551493 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-f3395b8a-4895-489b-80d0-02f7a140edae tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1503 microversion: 2.1 time: 0.163367 Sep 05 12:31:33.552856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 165/318] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:33 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:33.578356 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-59115fdd-c8c9-4986-be06-56b7e122f7dc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:33.578970 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-59115fdd-c8c9-4986-be06-56b7e122f7dc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:33.641531 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-59115fdd-c8c9-4986-be06-56b7e122f7dc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:33.649992 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-59115fdd-c8c9-4986-be06-56b7e122f7dc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1242 microversion: 2.1 time: 0.075518 Sep 05 12:31:33.650587 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 154/319] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:33 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:34.110526 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-bd7ed32f-eef2-474a-bf46-d3b7e72bafc0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:34.111162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-bd7ed32f-eef2-474a-bf46-d3b7e72bafc0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:34.118020 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bd7ed32f-eef2-474a-bf46-d3b7e72bafc0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:34.118507 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bd7ed32f-eef2-474a-bf46-d3b7e72bafc0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:34.118937 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bd7ed32f-eef2-474a-bf46-d3b7e72bafc0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:34.119670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bd7ed32f-eef2-474a-bf46-d3b7e72bafc0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:34.120124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bd7ed32f-eef2-474a-bf46-d3b7e72bafc0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:34.120548 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bd7ed32f-eef2-474a-bf46-d3b7e72bafc0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:34.306992 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-bd7ed32f-eef2-474a-bf46-d3b7e72bafc0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:34.317366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-bd7ed32f-eef2-474a-bf46-d3b7e72bafc0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1511 microversion: 2.1 time: 0.210330 Sep 05 12:31:34.318132 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 166/320] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:34 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1511 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:34.408756 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ddb3661a-f781-439d-8167-632fc355f68f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:34.408756 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ddb3661a-f781-439d-8167-632fc355f68f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:34.416066 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ddb3661a-f781-439d-8167-632fc355f68f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:34.416559 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ddb3661a-f781-439d-8167-632fc355f68f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:34.416987 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ddb3661a-f781-439d-8167-632fc355f68f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:34.417718 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ddb3661a-f781-439d-8167-632fc355f68f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:34.418167 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ddb3661a-f781-439d-8167-632fc355f68f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:34.418587 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ddb3661a-f781-439d-8167-632fc355f68f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:34.567734 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ddb3661a-f781-439d-8167-632fc355f68f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:34.575903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-0300620f-c400-4c9c-a977-c72efbc42a7b tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:34.576512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-0300620f-c400-4c9c-a977-c72efbc42a7b tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:34.578864 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ddb3661a-f781-439d-8167-632fc355f68f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:34.580894 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ddb3661a-f781-439d-8167-632fc355f68f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:34.582429 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ddb3661a-f781-439d-8167-632fc355f68f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1722 microversion: 2.20 time: 0.178237 Sep 05 12:31:34.584326 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 155/321] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:34 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:34.590096 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0300620f-c400-4c9c-a977-c72efbc42a7b tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:34.590877 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0300620f-c400-4c9c-a977-c72efbc42a7b tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:34.592141 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0300620f-c400-4c9c-a977-c72efbc42a7b tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:34.593859 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0300620f-c400-4c9c-a977-c72efbc42a7b tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:34.594484 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0300620f-c400-4c9c-a977-c72efbc42a7b tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:34.595113 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0300620f-c400-4c9c-a977-c72efbc42a7b tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:34.679155 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-838e6167-3e47-43ad-b2d0-bbe9ec6a0455 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:34.679596 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-838e6167-3e47-43ad-b2d0-bbe9ec6a0455 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:34.687204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-838e6167-3e47-43ad-b2d0-bbe9ec6a0455 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:34.688043 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-838e6167-3e47-43ad-b2d0-bbe9ec6a0455 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:34.688771 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-838e6167-3e47-43ad-b2d0-bbe9ec6a0455 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:34.689911 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-838e6167-3e47-43ad-b2d0-bbe9ec6a0455 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:34.690606 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-838e6167-3e47-43ad-b2d0-bbe9ec6a0455 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:34.691390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-838e6167-3e47-43ad-b2d0-bbe9ec6a0455 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:34.756331 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-0300620f-c400-4c9c-a977-c72efbc42a7b tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:34.765577 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-838e6167-3e47-43ad-b2d0-bbe9ec6a0455 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:34.770382 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-0300620f-c400-4c9c-a977-c72efbc42a7b tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1503 microversion: 2.1 time: 0.198320 Sep 05 12:31:34.777022 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 167/322] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:34 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1503 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:34.784165 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-838e6167-3e47-43ad-b2d0-bbe9ec6a0455 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1246 microversion: 2.1 time: 0.109428 Sep 05 12:31:34.784787 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 156/323] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:34 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1246 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:35.336899 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e1fb361a-1fc8-4592-bdff-0b8babcb4157 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-333084798", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-384624755", "security_groups": [{"name": "tempest-secgroup-smoke-1211654380"}], "block_device_mapping_v2": [{"uuid": "b0749a81-97ae-49e4-91e0-5419b04cdfc7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "38f5b205-d0f7-419a-8f07-cc61071fe0f8"}]}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:31:35.342087 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0c9322d5-702f-400b-9544-7c97eb5918ce tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:35.343174 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0c9322d5-702f-400b-9544-7c97eb5918ce tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:35.351693 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c9322d5-702f-400b-9544-7c97eb5918ce tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:35.352877 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c9322d5-702f-400b-9544-7c97eb5918ce tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:35.355345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c9322d5-702f-400b-9544-7c97eb5918ce tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:35.356409 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c9322d5-702f-400b-9544-7c97eb5918ce tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:35.357361 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c9322d5-702f-400b-9544-7c97eb5918ce tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:35.358007 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c9322d5-702f-400b-9544-7c97eb5918ce tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:35.534141 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0c9322d5-702f-400b-9544-7c97eb5918ce tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:35.537145 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.network.neutron [None req-e1fb361a-1fc8-4592-bdff-0b8babcb4157 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] validate_networks() for [('38f5b205-d0f7-419a-8f07-cc61071fe0f8', None, None, None, None, None)] {{(pid=121210) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:31:35.544168 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0c9322d5-702f-400b-9544-7c97eb5918ce tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1511 microversion: 2.1 time: 0.207299 Sep 05 12:31:35.546045 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 157/324] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:35 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1511 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:35.619500 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a21b9d24-2fc9-472e-afda-77847317854f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:35.620216 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a21b9d24-2fc9-472e-afda-77847317854f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:35.631234 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a21b9d24-2fc9-472e-afda-77847317854f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:35.632546 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a21b9d24-2fc9-472e-afda-77847317854f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:35.633327 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a21b9d24-2fc9-472e-afda-77847317854f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:35.634610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a21b9d24-2fc9-472e-afda-77847317854f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:35.635289 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a21b9d24-2fc9-472e-afda-77847317854f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:35.635756 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a21b9d24-2fc9-472e-afda-77847317854f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:35.834685 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a21b9d24-2fc9-472e-afda-77847317854f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:35.861051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a21b9d24-2fc9-472e-afda-77847317854f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:35.863015 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a21b9d24-2fc9-472e-afda-77847317854f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:35.864461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a21b9d24-2fc9-472e-afda-77847317854f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1722 microversion: 2.20 time: 0.250467 Sep 05 12:31:35.865735 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 158/325] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:35 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:35.875131 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-fce0ea9c-dd17-4303-b922-bdaa268cf197 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:35.875775 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-fce0ea9c-dd17-4303-b922-bdaa268cf197 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:35.884055 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fce0ea9c-dd17-4303-b922-bdaa268cf197 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:35.884553 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fce0ea9c-dd17-4303-b922-bdaa268cf197 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:35.885154 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fce0ea9c-dd17-4303-b922-bdaa268cf197 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:35.886034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fce0ea9c-dd17-4303-b922-bdaa268cf197 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:35.886500 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fce0ea9c-dd17-4303-b922-bdaa268cf197 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:35.886927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fce0ea9c-dd17-4303-b922-bdaa268cf197 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:36.063412 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-fce0ea9c-dd17-4303-b922-bdaa268cf197 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:36.072800 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-e1fb361a-1fc8-4592-bdff-0b8babcb4157 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Flavor limits 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:31:36.073731 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-e1fb361a-1fc8-4592-bdff-0b8babcb4157 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Image limits 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:31:36.074501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-e1fb361a-1fc8-4592-bdff-0b8babcb4157 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Flavor pref 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:31:36.075056 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-e1fb361a-1fc8-4592-bdff-0b8babcb4157 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Image pref 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:31:36.075699 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-e1fb361a-1fc8-4592-bdff-0b8babcb4157 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:31:36.080912 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-fce0ea9c-dd17-4303-b922-bdaa268cf197 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1503 microversion: 2.1 time: 0.209172 Sep 05 12:31:36.082696 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 159/326] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:35 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1503 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:36.086597 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e1fb361a-1fc8-4592-bdff-0b8babcb4157 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:36.087455 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e1fb361a-1fc8-4592-bdff-0b8babcb4157 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:36.087893 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e1fb361a-1fc8-4592-bdff-0b8babcb4157 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:36.088808 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e1fb361a-1fc8-4592-bdff-0b8babcb4157 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:36.089447 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e1fb361a-1fc8-4592-bdff-0b8babcb4157 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:36.090093 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e1fb361a-1fc8-4592-bdff-0b8babcb4157 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:36.090571 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a7f18f4b-e0bb-4d5c-bbba-83f2474c6d08 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:36.091658 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a7f18f4b-e0bb-4d5c-bbba-83f2474c6d08 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:36.102640 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a7f18f4b-e0bb-4d5c-bbba-83f2474c6d08 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:36.103663 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a7f18f4b-e0bb-4d5c-bbba-83f2474c6d08 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:36.104530 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a7f18f4b-e0bb-4d5c-bbba-83f2474c6d08 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:36.106369 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a7f18f4b-e0bb-4d5c-bbba-83f2474c6d08 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:36.107064 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a7f18f4b-e0bb-4d5c-bbba-83f2474c6d08 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:36.108438 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a7f18f4b-e0bb-4d5c-bbba-83f2474c6d08 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:36.111868 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-e1fb361a-1fc8-4592-bdff-0b8babcb4157 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Getting quotas for project 4377cb4a93524abd99acb6ebe07fd1d6. Resources: {'ram', 'instances', 'cores'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:31:36.117651 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-e1fb361a-1fc8-4592-bdff-0b8babcb4157 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Getting quotas for user e7a29212dfae4a93beea7d11085cde63 and project 4377cb4a93524abd99acb6ebe07fd1d6. Resources: {'ram', 'instances', 'cores'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:31:36.194296 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-e1fb361a-1fc8-4592-bdff-0b8babcb4157 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Going to run 1 instances... {{(pid=121210) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:31:36.196463 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-e1fb361a-1fc8-4592-bdff-0b8babcb4157 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b0749a81-97ae-49e4-91e0-5419b04cdfc7',volume_size=None,volume_type=None)] {{(pid=121210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:31:36.198795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a7f18f4b-e0bb-4d5c-bbba-83f2474c6d08 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:36.206931 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a7f18f4b-e0bb-4d5c-bbba-83f2474c6d08 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1246 microversion: 2.1 time: 0.123249 Sep 05 12:31:36.207508 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 160/327] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:36 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1246 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:36.574477 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-605c947c-6858-4dc8-8592-86166502e030 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:36.575091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-605c947c-6858-4dc8-8592-86166502e030 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:36.582409 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-605c947c-6858-4dc8-8592-86166502e030 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:36.583093 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-605c947c-6858-4dc8-8592-86166502e030 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:36.583553 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-605c947c-6858-4dc8-8592-86166502e030 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:36.584359 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-605c947c-6858-4dc8-8592-86166502e030 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:36.584870 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-605c947c-6858-4dc8-8592-86166502e030 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:36.585299 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-605c947c-6858-4dc8-8592-86166502e030 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:36.711696 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-e1fb361a-1fc8-4592-bdff-0b8babcb4157 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.379504 Sep 05 12:31:36.712602 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 168/328] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Sep 5 12:31:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1381 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:31:36.725059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-59a7eb14-9b09-4577-8d04-d2f0fe076f2f tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:36.726051 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-59a7eb14-9b09-4577-8d04-d2f0fe076f2f tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:36.733312 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-605c947c-6858-4dc8-8592-86166502e030 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:36.746706 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-605c947c-6858-4dc8-8592-86166502e030 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1517 microversion: 2.1 time: 0.172365 Sep 05 12:31:36.746706 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 161/329] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:36 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:36.809545 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-59a7eb14-9b09-4577-8d04-d2f0fe076f2f tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:36.821398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-59a7eb14-9b09-4577-8d04-d2f0fe076f2f tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1093 microversion: 2.1 time: 0.101038 Sep 05 12:31:36.827068 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 169/330] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:36 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1093 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:36.898104 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-fc506d8c-4ad6-48c8-8590-2ff845ebd41f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:36.901738 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-fc506d8c-4ad6-48c8-8590-2ff845ebd41f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:36.909053 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fc506d8c-4ad6-48c8-8590-2ff845ebd41f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:36.910202 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fc506d8c-4ad6-48c8-8590-2ff845ebd41f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:36.911483 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fc506d8c-4ad6-48c8-8590-2ff845ebd41f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:36.913090 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fc506d8c-4ad6-48c8-8590-2ff845ebd41f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:36.913755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fc506d8c-4ad6-48c8-8590-2ff845ebd41f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:36.914374 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fc506d8c-4ad6-48c8-8590-2ff845ebd41f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:36.948463 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=100 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:37.081609 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-fc506d8c-4ad6-48c8-8590-2ff845ebd41f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:37.090082 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-fc506d8c-4ad6-48c8-8590-2ff845ebd41f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:37.091606 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-fc506d8c-4ad6-48c8-8590-2ff845ebd41f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:37.092823 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-fc506d8c-4ad6-48c8-8590-2ff845ebd41f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1743 microversion: 2.20 time: 0.200740 Sep 05 12:31:37.093384 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 162/331] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:36 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1743 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:37.104958 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ac1e45d3-6aa1-40e5-a01c-7a5f2e5373bc tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:37.105572 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-ac1e45d3-6aa1-40e5-a01c-7a5f2e5373bc tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:37.114304 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ac1e45d3-6aa1-40e5-a01c-7a5f2e5373bc tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:37.119650 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ac1e45d3-6aa1-40e5-a01c-7a5f2e5373bc tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:37.119650 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ac1e45d3-6aa1-40e5-a01c-7a5f2e5373bc tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:37.119650 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ac1e45d3-6aa1-40e5-a01c-7a5f2e5373bc tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:37.119650 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ac1e45d3-6aa1-40e5-a01c-7a5f2e5373bc tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:37.120047 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ac1e45d3-6aa1-40e5-a01c-7a5f2e5373bc tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:37.235980 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-538180fd-e4e3-4083-a9f2-64faa148c8c0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:37.235980 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-538180fd-e4e3-4083-a9f2-64faa148c8c0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:37.239571 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-538180fd-e4e3-4083-a9f2-64faa148c8c0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:37.241006 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-538180fd-e4e3-4083-a9f2-64faa148c8c0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:37.241480 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-538180fd-e4e3-4083-a9f2-64faa148c8c0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:37.242416 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-538180fd-e4e3-4083-a9f2-64faa148c8c0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:37.243032 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-538180fd-e4e3-4083-a9f2-64faa148c8c0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:37.243750 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-538180fd-e4e3-4083-a9f2-64faa148c8c0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:37.318520 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-ac1e45d3-6aa1-40e5-a01c-7a5f2e5373bc tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:37.327195 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-ac1e45d3-6aa1-40e5-a01c-7a5f2e5373bc tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1503 microversion: 2.1 time: 0.226309 Sep 05 12:31:37.327822 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 170/332] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:37 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1503 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:37.329091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-538180fd-e4e3-4083-a9f2-64faa148c8c0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:37.337452 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-538180fd-e4e3-4083-a9f2-64faa148c8c0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1238 microversion: 2.1 time: 0.111043 Sep 05 12:31:37.338300 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 163/333] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:37 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1238 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:37.850961 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-676f01f1-c25e-4e3b-9ab4-0322b43f1aba tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:37.851795 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-676f01f1-c25e-4e3b-9ab4-0322b43f1aba tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:37.917948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-676f01f1-c25e-4e3b-9ab4-0322b43f1aba tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:37.925252 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-676f01f1-c25e-4e3b-9ab4-0322b43f1aba tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1093 microversion: 2.1 time: 0.078711 Sep 05 12:31:37.925868 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 171/334] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:37 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1093 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:38.120140 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-aa5e845f-e39a-4662-836e-cd0d3b384780 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:38.120759 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-aa5e845f-e39a-4662-836e-cd0d3b384780 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:38.128101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa5e845f-e39a-4662-836e-cd0d3b384780 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:38.128878 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa5e845f-e39a-4662-836e-cd0d3b384780 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:38.129561 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa5e845f-e39a-4662-836e-cd0d3b384780 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:38.131031 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa5e845f-e39a-4662-836e-cd0d3b384780 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:38.131727 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa5e845f-e39a-4662-836e-cd0d3b384780 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:38.132353 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa5e845f-e39a-4662-836e-cd0d3b384780 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:38.283774 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-aa5e845f-e39a-4662-836e-cd0d3b384780 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:38.293932 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-aa5e845f-e39a-4662-836e-cd0d3b384780 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:38.293932 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-aa5e845f-e39a-4662-836e-cd0d3b384780 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:38.294842 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-aa5e845f-e39a-4662-836e-cd0d3b384780 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1743 microversion: 2.20 time: 0.179701 Sep 05 12:31:38.295402 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 164/335] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:38 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1743 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:38.350255 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7d9e626c-0ca3-49e1-90c7-3fa0ef494fb5 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:38.350958 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-7d9e626c-0ca3-49e1-90c7-3fa0ef494fb5 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:38.360975 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7d9e626c-0ca3-49e1-90c7-3fa0ef494fb5 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:38.366215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7d9e626c-0ca3-49e1-90c7-3fa0ef494fb5 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:38.366215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7d9e626c-0ca3-49e1-90c7-3fa0ef494fb5 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:38.366215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7d9e626c-0ca3-49e1-90c7-3fa0ef494fb5 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:38.366215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7d9e626c-0ca3-49e1-90c7-3fa0ef494fb5 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:38.366753 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7d9e626c-0ca3-49e1-90c7-3fa0ef494fb5 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:38.375868 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-bde46da3-693c-479a-af99-080643b789ef tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:38.377093 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-bde46da3-693c-479a-af99-080643b789ef tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:38.388590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bde46da3-693c-479a-af99-080643b789ef tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:38.389808 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bde46da3-693c-479a-af99-080643b789ef tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:38.391148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bde46da3-693c-479a-af99-080643b789ef tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:38.392568 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bde46da3-693c-479a-af99-080643b789ef tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:38.393367 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bde46da3-693c-479a-af99-080643b789ef tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:38.394158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bde46da3-693c-479a-af99-080643b789ef tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:38.462813 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-bde46da3-693c-479a-af99-080643b789ef tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:38.472334 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-bde46da3-693c-479a-af99-080643b789ef tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1238 microversion: 2.1 time: 0.112578 Sep 05 12:31:38.473056 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 165/336] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:38 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1238 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:38.520218 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-7d9e626c-0ca3-49e1-90c7-3fa0ef494fb5 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:38.528122 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-7d9e626c-0ca3-49e1-90c7-3fa0ef494fb5 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1503 microversion: 2.1 time: 0.181710 Sep 05 12:31:38.528704 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 172/337] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:38 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:38.877617 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-27dd5456-36dd-4683-8494-b03fa0de1eb8 req-ed160d35-4000-48ca-91b5-d8fa4be7a933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0105c66-6939-4b6d-b774-c1821012c1f0", "name": "network-vif-plugged", "status": "completed", "tag": "09dffb1b-f334-42d1-bd74-8b59ed4648c3"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:31:38.890059 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-27dd5456-36dd-4683-8494-b03fa0de1eb8 req-ed160d35-4000-48ca-91b5-d8fa4be7a933 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:38.890827 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-27dd5456-36dd-4683-8494-b03fa0de1eb8 req-ed160d35-4000-48ca-91b5-d8fa4be7a933 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:38.891380 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-27dd5456-36dd-4683-8494-b03fa0de1eb8 req-ed160d35-4000-48ca-91b5-d8fa4be7a933 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:38.903793 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-27dd5456-36dd-4683-8494-b03fa0de1eb8 req-ed160d35-4000-48ca-91b5-d8fa4be7a933 service nova] Creating event network-vif-plugged:09dffb1b-f334-42d1-bd74-8b59ed4648c3 for instance a0105c66-6939-4b6d-b774-c1821012c1f0 on hv-cinder-80135 Sep 05 12:31:38.909183 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-27dd5456-36dd-4683-8494-b03fa0de1eb8 req-ed160d35-4000-48ca-91b5-d8fa4be7a933 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036291 Sep 05 12:31:38.909848 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 166/338] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:31:38.948219 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-41736d95-9e3b-4611-9071-5184a0fe80de tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:38.948870 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-41736d95-9e3b-4611-9071-5184a0fe80de tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:38.955788 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-41736d95-9e3b-4611-9071-5184a0fe80de tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:38.956303 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-41736d95-9e3b-4611-9071-5184a0fe80de tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:38.956787 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-41736d95-9e3b-4611-9071-5184a0fe80de tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:38.957518 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-41736d95-9e3b-4611-9071-5184a0fe80de tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:38.957968 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-41736d95-9e3b-4611-9071-5184a0fe80de tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:38.958386 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-41736d95-9e3b-4611-9071-5184a0fe80de tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:39.033856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-41736d95-9e3b-4611-9071-5184a0fe80de tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:39.055927 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:39.059442 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-41736d95-9e3b-4611-9071-5184a0fe80de tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1143 microversion: 2.1 time: 0.115241 Sep 05 12:31:39.061290 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 173/339] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:38 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1143 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:39.330361 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e4d8f88f-4ed6-4c3b-a421-81f41f5a7020 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:39.333571 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e4d8f88f-4ed6-4c3b-a421-81f41f5a7020 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:39.353935 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e4d8f88f-4ed6-4c3b-a421-81f41f5a7020 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:39.354425 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e4d8f88f-4ed6-4c3b-a421-81f41f5a7020 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:39.358357 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e4d8f88f-4ed6-4c3b-a421-81f41f5a7020 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:39.358357 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e4d8f88f-4ed6-4c3b-a421-81f41f5a7020 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:39.358885 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e4d8f88f-4ed6-4c3b-a421-81f41f5a7020 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:39.359461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e4d8f88f-4ed6-4c3b-a421-81f41f5a7020 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:39.495892 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4b3c75ad-10a5-42c2-913e-5bd1b8590b99 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:39.496506 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-4b3c75ad-10a5-42c2-913e-5bd1b8590b99 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:39.513749 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4b3c75ad-10a5-42c2-913e-5bd1b8590b99 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:39.514660 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4b3c75ad-10a5-42c2-913e-5bd1b8590b99 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:39.515287 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4b3c75ad-10a5-42c2-913e-5bd1b8590b99 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:39.516282 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4b3c75ad-10a5-42c2-913e-5bd1b8590b99 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:39.517206 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4b3c75ad-10a5-42c2-913e-5bd1b8590b99 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:39.528758 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4b3c75ad-10a5-42c2-913e-5bd1b8590b99 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:39.558908 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e4d8f88f-4ed6-4c3b-a421-81f41f5a7020 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:39.569865 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e4d8f88f-4ed6-4c3b-a421-81f41f5a7020 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:39.571500 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e4d8f88f-4ed6-4c3b-a421-81f41f5a7020 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:39.572772 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e4d8f88f-4ed6-4c3b-a421-81f41f5a7020 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1743 microversion: 2.20 time: 0.253349 Sep 05 12:31:39.573679 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 167/340] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:39 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1743 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:39.578656 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ca37599c-b32f-4cff-bd98-5cc032a28f0d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:39.579528 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ca37599c-b32f-4cff-bd98-5cc032a28f0d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:39.589770 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ca37599c-b32f-4cff-bd98-5cc032a28f0d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:39.591244 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ca37599c-b32f-4cff-bd98-5cc032a28f0d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:39.591915 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ca37599c-b32f-4cff-bd98-5cc032a28f0d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:39.592957 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ca37599c-b32f-4cff-bd98-5cc032a28f0d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:39.593454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ca37599c-b32f-4cff-bd98-5cc032a28f0d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:39.593883 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ca37599c-b32f-4cff-bd98-5cc032a28f0d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:39.611744 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-4b3c75ad-10a5-42c2-913e-5bd1b8590b99 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:39.619683 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-4b3c75ad-10a5-42c2-913e-5bd1b8590b99 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1294 microversion: 2.1 time: 0.127720 Sep 05 12:31:39.623650 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 174/341] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:39 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1294 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:39.820424 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4711fb6d-bb3c-4e94-8c5b-0b2bfa5da4e4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Action: 'create', calling method: .version_select at 0x7fe712c89700>, body: {"keypair": {"name": "tempest-keypair-852969297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo8C3S3kldk7aUUs3tQi9i87LdO59EKOD4I8peXgrMbcUwfpCQISQbZ29OSxSRZTgz3hBlZioQ6LuIGyf0295SL/2dqMTfdyYsEq6b88bULTZtP1SbbUYla2W5GTmQBJw=="}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:31:39.870424 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-4711fb6d-bb3c-4e94-8c5b-0b2bfa5da4e4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Getting quotas for project 442bf64c97d945feb79f64cdd66baa28. Resources: {'key_pairs'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:31:39.888507 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-4711fb6d-bb3c-4e94-8c5b-0b2bfa5da4e4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Getting quotas for user f5543fbd902d441cb6f03d3155f1af8d and project 442bf64c97d945feb79f64cdd66baa28. Resources: {'key_pairs'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:31:39.982223 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ca37599c-b32f-4cff-bd98-5cc032a28f0d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:39.990571 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ca37599c-b32f-4cff-bd98-5cc032a28f0d tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1503 microversion: 2.1 time: 0.415199 Sep 05 12:31:39.991216 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 168/342] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:39 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1503 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:39.996664 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-b020af01-535f-4eb3-9cef-c68ffce40de9 req-c84d999c-a416-4714-8377-40e3454fff1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57cc6b84-25f0-45bc-9947-d348ed26463a", "name": "network-vif-deleted", "tag": "ed9f84cc-e853-45d8-af65-689cc068ec82"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:31:40.007961 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-b020af01-535f-4eb3-9cef-c68ffce40de9 req-c84d999c-a416-4714-8377-40e3454fff1a service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:40.008544 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-b020af01-535f-4eb3-9cef-c68ffce40de9 req-c84d999c-a416-4714-8377-40e3454fff1a service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:40.009042 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-b020af01-535f-4eb3-9cef-c68ffce40de9 req-c84d999c-a416-4714-8377-40e3454fff1a service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:40.020312 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-b020af01-535f-4eb3-9cef-c68ffce40de9 req-c84d999c-a416-4714-8377-40e3454fff1a service nova] Creating event network-vif-deleted:ed9f84cc-e853-45d8-af65-689cc068ec82 for instance 57cc6b84-25f0-45bc-9947-d348ed26463a on hv-cinder-80135 Sep 05 12:31:40.025619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-b020af01-535f-4eb3-9cef-c68ffce40de9 req-c84d999c-a416-4714-8377-40e3454fff1a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033082 Sep 05 12:31:40.026284 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 169/343] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:31:40.032732 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-4711fb6d-bb3c-4e94-8c5b-0b2bfa5da4e4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.218126 Sep 05 12:31:40.037223 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 175/344] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Sep 5 12:31:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:31:40.090487 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-6fd0dc97-6188-4273-91bc-eee8cb699365 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:40.092207 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-6fd0dc97-6188-4273-91bc-eee8cb699365 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:40.104445 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6fd0dc97-6188-4273-91bc-eee8cb699365 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:40.104994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6fd0dc97-6188-4273-91bc-eee8cb699365 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:40.105523 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6fd0dc97-6188-4273-91bc-eee8cb699365 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:40.106573 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6fd0dc97-6188-4273-91bc-eee8cb699365 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:40.107356 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6fd0dc97-6188-4273-91bc-eee8cb699365 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:40.107833 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6fd0dc97-6188-4273-91bc-eee8cb699365 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:40.173097 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6fd0dc97-6188-4273-91bc-eee8cb699365 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:40.181268 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-6fd0dc97-6188-4273-91bc-eee8cb699365 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1191 microversion: 2.1 time: 0.101454 Sep 05 12:31:40.181834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 170/345] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:40 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1191 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:40.598690 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-be0de254-70fb-482c-802b-55d97dd3a6e3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:40.600232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-be0de254-70fb-482c-802b-55d97dd3a6e3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:40.604561 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:40.614004 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-be0de254-70fb-482c-802b-55d97dd3a6e3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:40.614004 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-be0de254-70fb-482c-802b-55d97dd3a6e3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:40.614004 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-be0de254-70fb-482c-802b-55d97dd3a6e3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:40.614004 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-be0de254-70fb-482c-802b-55d97dd3a6e3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:40.614335 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-be0de254-70fb-482c-802b-55d97dd3a6e3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:40.614335 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-be0de254-70fb-482c-802b-55d97dd3a6e3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:40.642599 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-67d2ed36-7dad-4eca-9e05-674c74b4b701 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:40.643210 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-67d2ed36-7dad-4eca-9e05-674c74b4b701 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:40.650415 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-67d2ed36-7dad-4eca-9e05-674c74b4b701 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:40.651242 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-67d2ed36-7dad-4eca-9e05-674c74b4b701 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:40.651948 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-67d2ed36-7dad-4eca-9e05-674c74b4b701 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:40.652887 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-67d2ed36-7dad-4eca-9e05-674c74b4b701 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:40.653345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-67d2ed36-7dad-4eca-9e05-674c74b4b701 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:40.653768 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-67d2ed36-7dad-4eca-9e05-674c74b4b701 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:40.731953 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-67d2ed36-7dad-4eca-9e05-674c74b4b701 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:40.742449 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-67d2ed36-7dad-4eca-9e05-674c74b4b701 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1294 microversion: 2.1 time: 0.103878 Sep 05 12:31:40.745711 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 171/346] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:40 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1294 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:40.820879 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-be0de254-70fb-482c-802b-55d97dd3a6e3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:40.829113 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-be0de254-70fb-482c-802b-55d97dd3a6e3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:40.830551 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-be0de254-70fb-482c-802b-55d97dd3a6e3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:40.831831 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-be0de254-70fb-482c-802b-55d97dd3a6e3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1743 microversion: 2.20 time: 0.237341 Sep 05 12:31:40.832380 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 176/347] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:40 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1743 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:41.016413 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8e57273b-f4cb-48a4-8cde-3cbf980781e3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:41.016991 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-8e57273b-f4cb-48a4-8cde-3cbf980781e3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:41.024953 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8e57273b-f4cb-48a4-8cde-3cbf980781e3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:41.024953 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8e57273b-f4cb-48a4-8cde-3cbf980781e3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:41.024953 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8e57273b-f4cb-48a4-8cde-3cbf980781e3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:41.025463 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8e57273b-f4cb-48a4-8cde-3cbf980781e3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:41.025914 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8e57273b-f4cb-48a4-8cde-3cbf980781e3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:41.026359 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8e57273b-f4cb-48a4-8cde-3cbf980781e3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:41.064705 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8e57273b-f4cb-48a4-8cde-3cbf980781e3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:41.065371 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8e57273b-f4cb-48a4-8cde-3cbf980781e3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:41.065892 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8e57273b-f4cb-48a4-8cde-3cbf980781e3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:41.066447 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.objects.instance [None req-8e57273b-f4cb-48a4-8cde-3cbf980781e3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lazy-loading 'fault' on Instance uuid 57cc6b84-25f0-45bc-9947-d348ed26463a {{(pid=121211) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:31:41.118782 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-8e57273b-f4cb-48a4-8cde-3cbf980781e3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:41.128092 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-8e57273b-f4cb-48a4-8cde-3cbf980781e3 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1304 microversion: 2.1 time: 0.116420 Sep 05 12:31:41.129083 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 172/348] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:41 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:41.215008 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7843683a-958b-4e9c-815f-3d64506292f1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:41.216013 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-7843683a-958b-4e9c-815f-3d64506292f1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:41.222615 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7843683a-958b-4e9c-815f-3d64506292f1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:41.223109 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7843683a-958b-4e9c-815f-3d64506292f1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:41.223563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7843683a-958b-4e9c-815f-3d64506292f1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:41.224277 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7843683a-958b-4e9c-815f-3d64506292f1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:41.224766 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7843683a-958b-4e9c-815f-3d64506292f1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:41.225525 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7843683a-958b-4e9c-815f-3d64506292f1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:41.354115 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-7843683a-958b-4e9c-815f-3d64506292f1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:41.368591 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-7843683a-958b-4e9c-815f-3d64506292f1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1191 microversion: 2.1 time: 0.157131 Sep 05 12:31:41.370077 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 177/349] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:41 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1191 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:41.767822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ce725a0c-bb7a-4912-9e6e-34f1f6983e7f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:41.768443 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ce725a0c-bb7a-4912-9e6e-34f1f6983e7f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:41.776175 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ce725a0c-bb7a-4912-9e6e-34f1f6983e7f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:41.776477 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ce725a0c-bb7a-4912-9e6e-34f1f6983e7f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:41.777091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ce725a0c-bb7a-4912-9e6e-34f1f6983e7f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:41.778040 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ce725a0c-bb7a-4912-9e6e-34f1f6983e7f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:41.778660 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ce725a0c-bb7a-4912-9e6e-34f1f6983e7f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:41.779245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ce725a0c-bb7a-4912-9e6e-34f1f6983e7f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:41.851823 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ce725a0c-bb7a-4912-9e6e-34f1f6983e7f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:41.859449 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-c6935fb2-467d-441a-a3a7-ed2f7746b9a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:41.860098 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-c6935fb2-467d-441a-a3a7-ed2f7746b9a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:41.862584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ce725a0c-bb7a-4912-9e6e-34f1f6983e7f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1312 microversion: 2.1 time: 0.098715 Sep 05 12:31:41.863888 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 173/350] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:41 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:41.868580 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c6935fb2-467d-441a-a3a7-ed2f7746b9a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:41.869368 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c6935fb2-467d-441a-a3a7-ed2f7746b9a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:41.869973 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c6935fb2-467d-441a-a3a7-ed2f7746b9a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:41.870689 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c6935fb2-467d-441a-a3a7-ed2f7746b9a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:41.871143 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c6935fb2-467d-441a-a3a7-ed2f7746b9a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:41.871593 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c6935fb2-467d-441a-a3a7-ed2f7746b9a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:42.088241 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c6935fb2-467d-441a-a3a7-ed2f7746b9a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:42.096608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c6935fb2-467d-441a-a3a7-ed2f7746b9a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:42.098055 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c6935fb2-467d-441a-a3a7-ed2f7746b9a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:42.099240 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-c6935fb2-467d-441a-a3a7-ed2f7746b9a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1743 microversion: 2.20 time: 0.244649 Sep 05 12:31:42.101097 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 178/351] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:41 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1743 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:42.154522 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-542da224-a94f-4c52-9ee5-840f21d237c1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:42.155215 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-542da224-a94f-4c52-9ee5-840f21d237c1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:42.157240 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:42.163433 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-542da224-a94f-4c52-9ee5-840f21d237c1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:42.165557 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-542da224-a94f-4c52-9ee5-840f21d237c1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:42.165557 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-542da224-a94f-4c52-9ee5-840f21d237c1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:42.165557 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-542da224-a94f-4c52-9ee5-840f21d237c1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:42.165813 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-542da224-a94f-4c52-9ee5-840f21d237c1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:42.166156 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-542da224-a94f-4c52-9ee5-840f21d237c1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:42.209727 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-542da224-a94f-4c52-9ee5-840f21d237c1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:42.210264 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-542da224-a94f-4c52-9ee5-840f21d237c1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:42.210734 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-542da224-a94f-4c52-9ee5-840f21d237c1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:42.211189 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.objects.instance [None req-542da224-a94f-4c52-9ee5-840f21d237c1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lazy-loading 'fault' on Instance uuid 57cc6b84-25f0-45bc-9947-d348ed26463a {{(pid=121211) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:31:42.239068 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=2 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:42.273415 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-542da224-a94f-4c52-9ee5-840f21d237c1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:42.281289 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-542da224-a94f-4c52-9ee5-840f21d237c1 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1304 microversion: 2.1 time: 0.130768 Sep 05 12:31:42.281879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 174/352] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:42 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1304 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:42.394176 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-b7420a31-f4e9-4969-a294-c071354e5d57 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:42.394649 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-b7420a31-f4e9-4969-a294-c071354e5d57 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:42.401842 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b7420a31-f4e9-4969-a294-c071354e5d57 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:42.402330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b7420a31-f4e9-4969-a294-c071354e5d57 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:42.402946 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b7420a31-f4e9-4969-a294-c071354e5d57 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:42.403687 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b7420a31-f4e9-4969-a294-c071354e5d57 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:42.404141 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b7420a31-f4e9-4969-a294-c071354e5d57 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:42.404563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b7420a31-f4e9-4969-a294-c071354e5d57 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:42.488731 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-b7420a31-f4e9-4969-a294-c071354e5d57 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:42.496996 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-b7420a31-f4e9-4969-a294-c071354e5d57 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1199 microversion: 2.1 time: 0.107357 Sep 05 12:31:42.497582 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 179/353] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:42 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1199 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:42.891883 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-9b91d185-e30c-4bc5-a9ff-a591adcbb869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:42.892940 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-9b91d185-e30c-4bc5-a9ff-a591adcbb869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:42.901517 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9b91d185-e30c-4bc5-a9ff-a591adcbb869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:42.902096 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9b91d185-e30c-4bc5-a9ff-a591adcbb869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:42.902773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9b91d185-e30c-4bc5-a9ff-a591adcbb869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:42.903661 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9b91d185-e30c-4bc5-a9ff-a591adcbb869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:42.904316 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9b91d185-e30c-4bc5-a9ff-a591adcbb869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:42.904804 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9b91d185-e30c-4bc5-a9ff-a591adcbb869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:42.978180 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-9b91d185-e30c-4bc5-a9ff-a591adcbb869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:42.982370 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-9b91d185-e30c-4bc5-a9ff-a591adcbb869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1312 microversion: 2.1 time: 0.095562 Sep 05 12:31:42.982941 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 175/354] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:42 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:43.103113 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-43e8816c-b14b-4394-890f-12627303552e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-707193561", "imageRef": "7844cf5b-4975-4cb9-a7f8-31cc5e52098a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "adc4bf76-da99-44ec-b79e-0ddca4fe97de"}], "security_groups": [{"name": "tempest-securitygroup--1989802182"}], "key_name": "tempest-keypair-852969297", "user_data": "}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:31:43.125783 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1a18eb8a-1421-4d41-a9fc-cb67710b69ac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:43.126391 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1a18eb8a-1421-4d41-a9fc-cb67710b69ac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:43.132925 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1a18eb8a-1421-4d41-a9fc-cb67710b69ac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:43.133333 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1a18eb8a-1421-4d41-a9fc-cb67710b69ac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:43.133763 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1a18eb8a-1421-4d41-a9fc-cb67710b69ac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:43.134471 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1a18eb8a-1421-4d41-a9fc-cb67710b69ac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:43.134915 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1a18eb8a-1421-4d41-a9fc-cb67710b69ac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:43.135481 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1a18eb8a-1421-4d41-a9fc-cb67710b69ac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:43.208729 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.network.neutron [None req-43e8816c-b14b-4394-890f-12627303552e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] validate_networks() for [('adc4bf76-da99-44ec-b79e-0ddca4fe97de', None, None, None, None, None)] {{(pid=121210) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:31:43.269314 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1a18eb8a-1421-4d41-a9fc-cb67710b69ac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:43.277760 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1a18eb8a-1421-4d41-a9fc-cb67710b69ac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:43.279330 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1a18eb8a-1421-4d41-a9fc-cb67710b69ac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:43.280617 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1a18eb8a-1421-4d41-a9fc-cb67710b69ac tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1743 microversion: 2.20 time: 0.159122 Sep 05 12:31:43.281264 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 176/355] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:43 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:31:43.305697 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-960d240c-5a40-4bd4-b68e-90e04c2b9bd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:43.306371 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-960d240c-5a40-4bd4-b68e-90e04c2b9bd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:43.312621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-960d240c-5a40-4bd4-b68e-90e04c2b9bd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:43.313108 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-960d240c-5a40-4bd4-b68e-90e04c2b9bd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:43.313540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-960d240c-5a40-4bd4-b68e-90e04c2b9bd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:43.314244 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-960d240c-5a40-4bd4-b68e-90e04c2b9bd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:43.314692 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-960d240c-5a40-4bd4-b68e-90e04c2b9bd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:43.315140 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-960d240c-5a40-4bd4-b68e-90e04c2b9bd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:43.347284 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-960d240c-5a40-4bd4-b68e-90e04c2b9bd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:43.347799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-960d240c-5a40-4bd4-b68e-90e04c2b9bd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:43.348230 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-960d240c-5a40-4bd4-b68e-90e04c2b9bd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:43.348677 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.objects.instance [None req-960d240c-5a40-4bd4-b68e-90e04c2b9bd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lazy-loading 'fault' on Instance uuid 57cc6b84-25f0-45bc-9947-d348ed26463a {{(pid=121211) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:31:43.393042 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-960d240c-5a40-4bd4-b68e-90e04c2b9bd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:43.401004 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-960d240c-5a40-4bd4-b68e-90e04c2b9bd6 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1304 microversion: 2.1 time: 0.099832 Sep 05 12:31:43.402379 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 177/356] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:43 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:43.519916 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4ef3787a-4191-488c-ab2d-a8fc9376d0de tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:43.520659 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4ef3787a-4191-488c-ab2d-a8fc9376d0de tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:43.527218 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ef3787a-4191-488c-ab2d-a8fc9376d0de tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:43.527815 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ef3787a-4191-488c-ab2d-a8fc9376d0de tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:43.528316 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ef3787a-4191-488c-ab2d-a8fc9376d0de tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:43.529069 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ef3787a-4191-488c-ab2d-a8fc9376d0de tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:43.529610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ef3787a-4191-488c-ab2d-a8fc9376d0de tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:43.530116 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ef3787a-4191-488c-ab2d-a8fc9376d0de tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:43.594124 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-4ef3787a-4191-488c-ab2d-a8fc9376d0de tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:43.600702 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-43e8816c-b14b-4394-890f-12627303552e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Flavor limits 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:31:43.601127 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-43e8816c-b14b-4394-890f-12627303552e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Image limits 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:31:43.601597 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-43e8816c-b14b-4394-890f-12627303552e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Flavor pref 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:31:43.602004 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-43e8816c-b14b-4394-890f-12627303552e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Image pref 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:31:43.602419 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-43e8816c-b14b-4394-890f-12627303552e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:31:43.602532 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4ef3787a-4191-488c-ab2d-a8fc9376d0de tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1199 microversion: 2.1 time: 0.086466 Sep 05 12:31:43.603140 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 178/357] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:43 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1199 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:43.611697 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-43e8816c-b14b-4394-890f-12627303552e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:43.612180 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-43e8816c-b14b-4394-890f-12627303552e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:43.612820 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-43e8816c-b14b-4394-890f-12627303552e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:43.613553 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-43e8816c-b14b-4394-890f-12627303552e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:43.614000 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-43e8816c-b14b-4394-890f-12627303552e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:43.614423 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-43e8816c-b14b-4394-890f-12627303552e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:43.633123 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-43e8816c-b14b-4394-890f-12627303552e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Getting quotas for project 442bf64c97d945feb79f64cdd66baa28. Resources: {'ram', 'instances', 'cores'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:31:43.636985 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-43e8816c-b14b-4394-890f-12627303552e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Getting quotas for user f5543fbd902d441cb6f03d3155f1af8d and project 442bf64c97d945feb79f64cdd66baa28. Resources: {'ram', 'instances', 'cores'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:31:43.647927 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-43e8816c-b14b-4394-890f-12627303552e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Going to run 1 instances... {{(pid=121210) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:31:43.650000 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-43e8816c-b14b-4394-890f-12627303552e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7844cf5b-4975-4cb9-a7f8-31cc5e52098a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:31:43.780197 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-43e8816c-b14b-4394-890f-12627303552e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.681965 Sep 05 12:31:43.780843 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 180/358] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Sep 5 12:31:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:31:43.792995 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c9b7eeaa-31e4-491d-8377-e6f1854c2a85 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:43.793658 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-c9b7eeaa-31e4-491d-8377-e6f1854c2a85 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:43.796495 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=8 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:43.848672 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c9b7eeaa-31e4-491d-8377-e6f1854c2a85 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:43.856426 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-c9b7eeaa-31e4-491d-8377-e6f1854c2a85 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1244 microversion: 2.1 time: 0.068028 Sep 05 12:31:43.857008 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 179/359] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:43 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1244 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:44.005080 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-24285808-f3d8-4336-8a45-abf1ccee57a9 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:44.005738 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-24285808-f3d8-4336-8a45-abf1ccee57a9 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:44.011878 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-24285808-f3d8-4336-8a45-abf1ccee57a9 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:44.012367 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-24285808-f3d8-4336-8a45-abf1ccee57a9 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:44.012835 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-24285808-f3d8-4336-8a45-abf1ccee57a9 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:44.013528 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-24285808-f3d8-4336-8a45-abf1ccee57a9 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:44.013984 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-24285808-f3d8-4336-8a45-abf1ccee57a9 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:44.014408 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-24285808-f3d8-4336-8a45-abf1ccee57a9 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:44.082532 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-24285808-f3d8-4336-8a45-abf1ccee57a9 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:44.090270 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-24285808-f3d8-4336-8a45-abf1ccee57a9 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1312 microversion: 2.1 time: 0.089214 Sep 05 12:31:44.090815 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 181/360] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:43 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1312 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:44.306154 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-6abec1b7-458f-4e78-8e0e-6720e38a28bb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:44.306757 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-6abec1b7-458f-4e78-8e0e-6720e38a28bb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:44.314222 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6abec1b7-458f-4e78-8e0e-6720e38a28bb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:44.314792 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6abec1b7-458f-4e78-8e0e-6720e38a28bb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:44.315135 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6abec1b7-458f-4e78-8e0e-6720e38a28bb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:44.319756 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6abec1b7-458f-4e78-8e0e-6720e38a28bb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:44.319756 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6abec1b7-458f-4e78-8e0e-6720e38a28bb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:44.319756 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6abec1b7-458f-4e78-8e0e-6720e38a28bb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:44.335685 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=100 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:44.426397 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-403ce13b-c260-45e3-a75e-add13060f986 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:44.426397 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-403ce13b-c260-45e3-a75e-add13060f986 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:44.430694 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-403ce13b-c260-45e3-a75e-add13060f986 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:44.431177 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-403ce13b-c260-45e3-a75e-add13060f986 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:44.431636 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-403ce13b-c260-45e3-a75e-add13060f986 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:44.432334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-403ce13b-c260-45e3-a75e-add13060f986 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:44.432783 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-403ce13b-c260-45e3-a75e-add13060f986 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:44.433202 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-403ce13b-c260-45e3-a75e-add13060f986 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:44.444606 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6abec1b7-458f-4e78-8e0e-6720e38a28bb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:44.452786 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6abec1b7-458f-4e78-8e0e-6720e38a28bb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:44.454236 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6abec1b7-458f-4e78-8e0e-6720e38a28bb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:44.455603 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-6abec1b7-458f-4e78-8e0e-6720e38a28bb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1743 microversion: 2.20 time: 0.153134 Sep 05 12:31:44.460109 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 180/361] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:44 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:44.466363 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-403ce13b-c260-45e3-a75e-add13060f986 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:44.466946 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-403ce13b-c260-45e3-a75e-add13060f986 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:44.467560 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-403ce13b-c260-45e3-a75e-add13060f986 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:44.468145 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-403ce13b-c260-45e3-a75e-add13060f986 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lazy-loading 'fault' on Instance uuid 57cc6b84-25f0-45bc-9947-d348ed26463a {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:31:44.510459 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-403ce13b-c260-45e3-a75e-add13060f986 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a669f6cbac5a4d84a9e71c27c01969ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ecc5cd1d854b17bbe9ee678ecacfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:44.518493 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-403ce13b-c260-45e3-a75e-add13060f986 tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 200 len: 1304 microversion: 2.1 time: 0.098684 Sep 05 12:31:44.519153 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 182/362] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:44 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:44.626371 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a9a18388-0df1-4482-80e5-57854fc73d94 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:44.627070 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a9a18388-0df1-4482-80e5-57854fc73d94 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:44.636414 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a9a18388-0df1-4482-80e5-57854fc73d94 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:44.637110 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a9a18388-0df1-4482-80e5-57854fc73d94 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:44.637746 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a9a18388-0df1-4482-80e5-57854fc73d94 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:44.638738 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a9a18388-0df1-4482-80e5-57854fc73d94 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:44.643774 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a9a18388-0df1-4482-80e5-57854fc73d94 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:44.643774 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a9a18388-0df1-4482-80e5-57854fc73d94 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:44.721250 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a9a18388-0df1-4482-80e5-57854fc73d94 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:44.731501 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a9a18388-0df1-4482-80e5-57854fc73d94 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1199 microversion: 2.1 time: 0.108854 Sep 05 12:31:44.732793 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 181/363] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:44 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1199 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:44.889695 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-cee6e5b3-ffe9-447e-a36a-db228d6e9873 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:44.891086 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-cee6e5b3-ffe9-447e-a36a-db228d6e9873 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:44.903730 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cee6e5b3-ffe9-447e-a36a-db228d6e9873 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:44.905584 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cee6e5b3-ffe9-447e-a36a-db228d6e9873 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:44.906954 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cee6e5b3-ffe9-447e-a36a-db228d6e9873 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:44.908290 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cee6e5b3-ffe9-447e-a36a-db228d6e9873 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:44.908905 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cee6e5b3-ffe9-447e-a36a-db228d6e9873 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:44.909483 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cee6e5b3-ffe9-447e-a36a-db228d6e9873 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:45.025078 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-cee6e5b3-ffe9-447e-a36a-db228d6e9873 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:45.032901 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-cee6e5b3-ffe9-447e-a36a-db228d6e9873 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1248 microversion: 2.1 time: 0.154305 Sep 05 12:31:45.033472 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 183/364] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:44 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1248 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:45.115446 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1fbd2fd1-7349-41d3-8a9d-1eaf6e5f12a6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:45.117300 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1fbd2fd1-7349-41d3-8a9d-1eaf6e5f12a6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:45.125068 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1fbd2fd1-7349-41d3-8a9d-1eaf6e5f12a6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:45.125741 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1fbd2fd1-7349-41d3-8a9d-1eaf6e5f12a6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:45.126333 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1fbd2fd1-7349-41d3-8a9d-1eaf6e5f12a6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:45.127200 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1fbd2fd1-7349-41d3-8a9d-1eaf6e5f12a6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:45.127855 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1fbd2fd1-7349-41d3-8a9d-1eaf6e5f12a6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:45.128454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1fbd2fd1-7349-41d3-8a9d-1eaf6e5f12a6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:45.223865 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1fbd2fd1-7349-41d3-8a9d-1eaf6e5f12a6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:45.233664 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1fbd2fd1-7349-41d3-8a9d-1eaf6e5f12a6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1300 microversion: 2.1 time: 0.123635 Sep 05 12:31:45.234533 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 182/365] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:45 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1300 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:45.488383 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-9f47f8ff-1fe9-4029-b2d2-6f5d1897ade2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:45.489075 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-9f47f8ff-1fe9-4029-b2d2-6f5d1897ade2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:45.542181 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9f47f8ff-1fe9-4029-b2d2-6f5d1897ade2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:45.542181 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9f47f8ff-1fe9-4029-b2d2-6f5d1897ade2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:45.542181 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9f47f8ff-1fe9-4029-b2d2-6f5d1897ade2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:45.542181 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9f47f8ff-1fe9-4029-b2d2-6f5d1897ade2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:45.551781 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9f47f8ff-1fe9-4029-b2d2-6f5d1897ade2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:45.551781 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9f47f8ff-1fe9-4029-b2d2-6f5d1897ade2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:45.554776 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-bacd0d1a-8c41-424e-9fff-c4787178764c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:45.564729 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-bacd0d1a-8c41-424e-9fff-c4787178764c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] [instance: 57cc6b84-25f0-45bc-9947-d348ed26463a] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:45.585291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bacd0d1a-8c41-424e-9fff-c4787178764c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:45.585927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bacd0d1a-8c41-424e-9fff-c4787178764c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:45.586379 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bacd0d1a-8c41-424e-9fff-c4787178764c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:45.587337 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bacd0d1a-8c41-424e-9fff-c4787178764c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:45.588082 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bacd0d1a-8c41-424e-9fff-c4787178764c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:45.588679 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bacd0d1a-8c41-424e-9fff-c4787178764c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:45.607411 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-bacd0d1a-8c41-424e-9fff-c4787178764c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] HTTP exception thrown: Instance 57cc6b84-25f0-45bc-9947-d348ed26463a could not be found. Sep 05 12:31:45.610767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-bacd0d1a-8c41-424e-9fff-c4787178764c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Request method failure captured: Sep 05 12:31:45.610767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a HTTP/1.1 Sep 05 12:31:45.610767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:31:45.610767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:31:45.610767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:31:45.610767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:31:45.610767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:31:45.610767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:31:45.610767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:31:45.610767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:31:45.610767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFevlVa6TaakpknHyKf6F8E9QLm9gnoNWcihznEhqbrtd9M8WG_Cogr1TpXN6ulECpF4CRrboEa_RKMg5h_9U5lKrFph2fJ2hfE3pn06s5bbpj0kVqYBvbrS79cLT5VTXqVmMzi5lQmYCXklK17P-jbzMp-a2v2eMb_IRrjbgCWNYhVg Sep 05 12:31:45.610767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:31:45.610767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:31:45.610767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:31:45.610767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:31:45.610767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:31:45.610767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:31:45.610767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: d5ecc5cd1d854b17bbe9ee678ecacfe3 Sep 05 12:31:45.610767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-VolumesActionsTest-1274481575 Sep 05 12:31:45.610767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:31:45.610767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:31:45.612128 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d5ecc5cd1d854b17bbe9ee678ecacfe3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d5ecc5cd1d854b17bbe9ee678ecacfe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d5ecc5cd1d854b17bbe9ee678ecacfe3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d5ecc5cd1d854b17bbe9ee678ecacfe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:31:45.612128 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-VolumesActionsTest-1274481575 Sep 05 12:31:45.612128 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: d5ecc5cd1d854b17bbe9ee678ecacfe3 Sep 05 12:31:45.612128 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-VolumesActionsTest-1274481575 Sep 05 12:31:45.612128 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-VolumesActionsTest-1274481575-project Sep 05 12:31:45.612128 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:31:45.612128 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:31:45.612128 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: a669f6cbac5a4d84a9e71c27c01969ff Sep 05 12:31:45.612128 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-VolumesActionsTest-1274481575-project Sep 05 12:31:45.612128 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: > Sep 05 12:31:45.612128 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Instance 57cc6b84-25f0-45bc-9947-d348ed26463a could not be found. Sep 05 12:31:45.612128 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': '57cc6b84-25f0-45bc-9947-d348ed26463a'} Sep 05 12:31:45.612879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:31:45.612879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:31:45.612879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:31:45.612879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:31:45.612879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:31:45.612879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:31:45.612879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:31:45.612879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:31:45.612879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:31:45.612879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:31:45.612879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57cc6b84-25f0-45bc-9947-d348ed26463a could not be found. Sep 05 12:31:45.612879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:31:45.612879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:31:45.612879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:31:45.612879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:31:45.612879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:31:45.612879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:31:45.612879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:31:45.612879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:31:45.612879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:31:45.616937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:31:45.616937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:31:45.616937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:31:45.616937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:31:45.616937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:31:45.616937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:31:45.616937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:31:45.616937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57cc6b84-25f0-45bc-9947-d348ed26463a could not be found. Sep 05 12:31:45.616937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:31:45.616937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:31:45.616937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:31:45.616937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:31:45.616937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:31:45.616937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:31:45.616937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:31:45.616937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:31:45.616937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57cc6b84-25f0-45bc-9947-d348ed26463a could not be found. Sep 05 12:31:45.616937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:31:45.617988 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-bacd0d1a-8c41-424e-9fff-c4787178764c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] Returning 404 to user: Instance 57cc6b84-25f0-45bc-9947-d348ed26463a could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:31:45.617988 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-bacd0d1a-8c41-424e-9fff-c4787178764c tempest-VolumesActionsTest-1274481575 tempest-VolumesActionsTest-1274481575-project] 10.222.0.62 "GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a" status: 404 len: 111 microversion: 2.1 time: 0.068907 Sep 05 12:31:45.617988 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 183/366] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:45 2022] GET /compute/v2.1/servers/57cc6b84-25f0-45bc-9947-d348ed26463a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:31:45.757679 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-645b74c7-92c1-4fb7-b001-0b030742aba2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:45.758647 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-645b74c7-92c1-4fb7-b001-0b030742aba2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:45.773544 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-645b74c7-92c1-4fb7-b001-0b030742aba2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:45.774068 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-645b74c7-92c1-4fb7-b001-0b030742aba2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:45.774495 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-645b74c7-92c1-4fb7-b001-0b030742aba2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:45.777829 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-645b74c7-92c1-4fb7-b001-0b030742aba2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:45.778390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-645b74c7-92c1-4fb7-b001-0b030742aba2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:45.778734 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-645b74c7-92c1-4fb7-b001-0b030742aba2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:45.945902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-9f47f8ff-1fe9-4029-b2d2-6f5d1897ade2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:45.974681 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-9f47f8ff-1fe9-4029-b2d2-6f5d1897ade2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:46.021344 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-9f47f8ff-1fe9-4029-b2d2-6f5d1897ade2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:46.027614 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-9f47f8ff-1fe9-4029-b2d2-6f5d1897ade2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1738 microversion: 2.20 time: 0.541907 Sep 05 12:31:46.027614 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 184/367] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:45 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1738 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:46.060682 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1e58b3a9-0d40-4676-ae67-559f37351e32 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:46.061307 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1e58b3a9-0d40-4676-ae67-559f37351e32 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:46.083011 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1e58b3a9-0d40-4676-ae67-559f37351e32 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:46.084067 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1e58b3a9-0d40-4676-ae67-559f37351e32 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:46.096513 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1e58b3a9-0d40-4676-ae67-559f37351e32 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:46.096513 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1e58b3a9-0d40-4676-ae67-559f37351e32 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:46.096513 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1e58b3a9-0d40-4676-ae67-559f37351e32 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:46.096803 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1e58b3a9-0d40-4676-ae67-559f37351e32 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:46.165836 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-645b74c7-92c1-4fb7-b001-0b030742aba2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:46.192037 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-645b74c7-92c1-4fb7-b001-0b030742aba2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1277 microversion: 2.1 time: 0.422587 Sep 05 12:31:46.209569 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 184/368] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:45 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1277 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:46.260135 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-febe0f5f-49e8-4477-a6d4-a990afcee742 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:46.263064 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-febe0f5f-49e8-4477-a6d4-a990afcee742 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:46.274725 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-febe0f5f-49e8-4477-a6d4-a990afcee742 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:46.276847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-febe0f5f-49e8-4477-a6d4-a990afcee742 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:46.278050 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-febe0f5f-49e8-4477-a6d4-a990afcee742 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:46.280865 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-febe0f5f-49e8-4477-a6d4-a990afcee742 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:46.281358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-febe0f5f-49e8-4477-a6d4-a990afcee742 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:46.281806 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-febe0f5f-49e8-4477-a6d4-a990afcee742 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:46.395411 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1e58b3a9-0d40-4676-ae67-559f37351e32 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:46.421805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1e58b3a9-0d40-4676-ae67-559f37351e32 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1296 microversion: 2.1 time: 0.369595 Sep 05 12:31:46.422398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 185/369] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:46 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1296 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:46.677116 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-febe0f5f-49e8-4477-a6d4-a990afcee742 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:46.691509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-febe0f5f-49e8-4477-a6d4-a990afcee742 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1368 microversion: 2.1 time: 0.435765 Sep 05 12:31:46.694359 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 185/370] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:46 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1368 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:47.062682 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-60ede550-49b3-4e5b-8e6b-cc5bd61f8ad0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:47.062682 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-60ede550-49b3-4e5b-8e6b-cc5bd61f8ad0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:47.080562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-60ede550-49b3-4e5b-8e6b-cc5bd61f8ad0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:47.085179 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-60ede550-49b3-4e5b-8e6b-cc5bd61f8ad0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:47.086011 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-60ede550-49b3-4e5b-8e6b-cc5bd61f8ad0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:47.087243 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-60ede550-49b3-4e5b-8e6b-cc5bd61f8ad0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:47.088906 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-60ede550-49b3-4e5b-8e6b-cc5bd61f8ad0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:47.089528 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-60ede550-49b3-4e5b-8e6b-cc5bd61f8ad0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:47.223278 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-2453758f-823c-4420-8ccd-83f70a920429 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:47.224238 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-2453758f-823c-4420-8ccd-83f70a920429 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:47.237900 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2453758f-823c-4420-8ccd-83f70a920429 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:47.241647 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2453758f-823c-4420-8ccd-83f70a920429 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:47.243273 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2453758f-823c-4420-8ccd-83f70a920429 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:47.244801 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2453758f-823c-4420-8ccd-83f70a920429 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:47.246734 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2453758f-823c-4420-8ccd-83f70a920429 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:47.247585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2453758f-823c-4420-8ccd-83f70a920429 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:47.454956 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-60ede550-49b3-4e5b-8e6b-cc5bd61f8ad0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:47.487473 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-60ede550-49b3-4e5b-8e6b-cc5bd61f8ad0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:47.487473 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-60ede550-49b3-4e5b-8e6b-cc5bd61f8ad0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:47.487473 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-60ede550-49b3-4e5b-8e6b-cc5bd61f8ad0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1738 microversion: 2.20 time: 0.413916 Sep 05 12:31:47.487831 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 186/371] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:47 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1738 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:47.487831 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-f5acde7a-ddb8-48c3-924f-92a2e5f8a11a req-918a38c5-b012-4bea-b63d-54b064b50e04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fac517b0-9cbe-4a6a-8922-21166ec0de63", "tag": "d28f89a7-e984-4c77-9cae-fe03a7c5c344"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:31:47.493539 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-f5acde7a-ddb8-48c3-924f-92a2e5f8a11a req-918a38c5-b012-4bea-b63d-54b064b50e04 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:47.494223 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-f5acde7a-ddb8-48c3-924f-92a2e5f8a11a req-918a38c5-b012-4bea-b63d-54b064b50e04 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:47.495217 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-f5acde7a-ddb8-48c3-924f-92a2e5f8a11a req-918a38c5-b012-4bea-b63d-54b064b50e04 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:47.523367 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-f5acde7a-ddb8-48c3-924f-92a2e5f8a11a req-918a38c5-b012-4bea-b63d-54b064b50e04 service nova] Creating event network-changed:d28f89a7-e984-4c77-9cae-fe03a7c5c344 for instance fac517b0-9cbe-4a6a-8922-21166ec0de63 on hv-cinder-80135 Sep 05 12:31:47.535175 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-f5acde7a-ddb8-48c3-924f-92a2e5f8a11a req-918a38c5-b012-4bea-b63d-54b064b50e04 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061395 Sep 05 12:31:47.536616 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 187/372] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:31:47.544243 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-472a7730-a518-406a-9da9-c1e9e99920e5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:47.545617 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-472a7730-a518-406a-9da9-c1e9e99920e5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:47.558620 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-472a7730-a518-406a-9da9-c1e9e99920e5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:47.559927 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-472a7730-a518-406a-9da9-c1e9e99920e5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:47.562041 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-472a7730-a518-406a-9da9-c1e9e99920e5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:47.563138 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-472a7730-a518-406a-9da9-c1e9e99920e5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:47.565658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-472a7730-a518-406a-9da9-c1e9e99920e5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:47.581144 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-472a7730-a518-406a-9da9-c1e9e99920e5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:47.734505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-472a7730-a518-406a-9da9-c1e9e99920e5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:47.745292 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-2453758f-823c-4420-8ccd-83f70a920429 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:47.748784 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-472a7730-a518-406a-9da9-c1e9e99920e5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1304 microversion: 2.1 time: 0.210011 Sep 05 12:31:47.753536 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-2453758f-823c-4420-8ccd-83f70a920429 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1277 microversion: 2.1 time: 0.535671 Sep 05 12:31:47.754819 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 188/373] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:47 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1304 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:47.757760 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 186/374] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:47 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1277 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:47.769296 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-003b612b-6816-46f3-95e0-e8fae7a4180d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:47.774639 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-003b612b-6816-46f3-95e0-e8fae7a4180d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:47.788501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-003b612b-6816-46f3-95e0-e8fae7a4180d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:47.791456 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-003b612b-6816-46f3-95e0-e8fae7a4180d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:47.794217 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-003b612b-6816-46f3-95e0-e8fae7a4180d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:47.798198 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-003b612b-6816-46f3-95e0-e8fae7a4180d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:47.800395 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-003b612b-6816-46f3-95e0-e8fae7a4180d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:47.803870 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-003b612b-6816-46f3-95e0-e8fae7a4180d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:48.082563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-003b612b-6816-46f3-95e0-e8fae7a4180d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:48.107836 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-003b612b-6816-46f3-95e0-e8fae7a4180d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1368 microversion: 2.1 time: 0.351971 Sep 05 12:31:48.113316 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 189/375] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:47 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1368 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:48.144754 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-91de8cf8-76cf-4cfe-ac17-5361ab15b7ee req-08e03ac3-ae08-4e71-8ac8-b75513852b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee288301-eeb1-4e09-8a2c-d9bc6c00d914", "tag": "ebc2ee9e-37fa-4dbd-bf0a-e1f2b070c9fc"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:31:48.162206 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-91de8cf8-76cf-4cfe-ac17-5361ab15b7ee req-08e03ac3-ae08-4e71-8ac8-b75513852b71 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:48.163372 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-91de8cf8-76cf-4cfe-ac17-5361ab15b7ee req-08e03ac3-ae08-4e71-8ac8-b75513852b71 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:48.164464 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-91de8cf8-76cf-4cfe-ac17-5361ab15b7ee req-08e03ac3-ae08-4e71-8ac8-b75513852b71 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:48.182186 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-91de8cf8-76cf-4cfe-ac17-5361ab15b7ee req-08e03ac3-ae08-4e71-8ac8-b75513852b71 service nova] Creating event network-changed:ebc2ee9e-37fa-4dbd-bf0a-e1f2b070c9fc for instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 on hv-cinder-80135 Sep 05 12:31:48.188918 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-91de8cf8-76cf-4cfe-ac17-5361ab15b7ee req-08e03ac3-ae08-4e71-8ac8-b75513852b71 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051004 Sep 05 12:31:48.197213 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 187/376] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:31:48.507800 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a5ed989a-1d55-4b88-b79b-1a15fcc36a5a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:48.508873 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a5ed989a-1d55-4b88-b79b-1a15fcc36a5a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:48.516254 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a5ed989a-1d55-4b88-b79b-1a15fcc36a5a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:48.517024 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a5ed989a-1d55-4b88-b79b-1a15fcc36a5a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:48.517740 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a5ed989a-1d55-4b88-b79b-1a15fcc36a5a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:48.518492 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a5ed989a-1d55-4b88-b79b-1a15fcc36a5a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:48.518955 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a5ed989a-1d55-4b88-b79b-1a15fcc36a5a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:48.519378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a5ed989a-1d55-4b88-b79b-1a15fcc36a5a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:48.699925 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a5ed989a-1d55-4b88-b79b-1a15fcc36a5a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:48.709626 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a5ed989a-1d55-4b88-b79b-1a15fcc36a5a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:48.711375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a5ed989a-1d55-4b88-b79b-1a15fcc36a5a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:48.712890 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a5ed989a-1d55-4b88-b79b-1a15fcc36a5a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1738 microversion: 2.20 time: 0.210466 Sep 05 12:31:48.713611 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 190/377] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:48 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1738 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:48.779121 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ba7ca342-18a6-49c9-9d8b-2992ace27d22 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:48.779861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ba7ca342-18a6-49c9-9d8b-2992ace27d22 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:48.780894 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-3dbd8be0-4070-4201-92d6-df5d1988e568 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:48.781549 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-3dbd8be0-4070-4201-92d6-df5d1988e568 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:48.788999 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ba7ca342-18a6-49c9-9d8b-2992ace27d22 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:48.800118 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ba7ca342-18a6-49c9-9d8b-2992ace27d22 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:48.800118 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ba7ca342-18a6-49c9-9d8b-2992ace27d22 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:48.800118 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ba7ca342-18a6-49c9-9d8b-2992ace27d22 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:48.800118 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ba7ca342-18a6-49c9-9d8b-2992ace27d22 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:48.800803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ba7ca342-18a6-49c9-9d8b-2992ace27d22 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:48.801003 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3dbd8be0-4070-4201-92d6-df5d1988e568 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:48.801003 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3dbd8be0-4070-4201-92d6-df5d1988e568 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:48.801003 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3dbd8be0-4070-4201-92d6-df5d1988e568 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:48.801003 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3dbd8be0-4070-4201-92d6-df5d1988e568 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:48.801511 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3dbd8be0-4070-4201-92d6-df5d1988e568 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:48.801511 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3dbd8be0-4070-4201-92d6-df5d1988e568 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:49.006847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ba7ca342-18a6-49c9-9d8b-2992ace27d22 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:49.027161 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ba7ca342-18a6-49c9-9d8b-2992ace27d22 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1304 microversion: 2.1 time: 0.251930 Sep 05 12:31:49.039157 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 188/378] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:48 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1304 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:49.067563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-3dbd8be0-4070-4201-92d6-df5d1988e568 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:49.077949 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-3dbd8be0-4070-4201-92d6-df5d1988e568 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1277 microversion: 2.1 time: 0.302083 Sep 05 12:31:49.083877 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 191/379] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:48 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1277 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:49.131190 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f2d3cef8-c199-41d7-9f52-7f9fd0f0a86a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:49.131788 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f2d3cef8-c199-41d7-9f52-7f9fd0f0a86a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:49.138055 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f2d3cef8-c199-41d7-9f52-7f9fd0f0a86a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:49.138783 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f2d3cef8-c199-41d7-9f52-7f9fd0f0a86a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:49.139462 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f2d3cef8-c199-41d7-9f52-7f9fd0f0a86a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:49.140369 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f2d3cef8-c199-41d7-9f52-7f9fd0f0a86a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:49.140824 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f2d3cef8-c199-41d7-9f52-7f9fd0f0a86a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:49.141416 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f2d3cef8-c199-41d7-9f52-7f9fd0f0a86a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:49.312086 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f2d3cef8-c199-41d7-9f52-7f9fd0f0a86a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:49.329403 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f2d3cef8-c199-41d7-9f52-7f9fd0f0a86a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1368 microversion: 2.1 time: 0.202155 Sep 05 12:31:49.331261 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 189/380] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:49 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:49.738937 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ba3c82c4-4d66-4223-ac8b-9150b08ed0f5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:49.739728 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-ba3c82c4-4d66-4223-ac8b-9150b08ed0f5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:49.749956 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ba3c82c4-4d66-4223-ac8b-9150b08ed0f5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:49.750460 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ba3c82c4-4d66-4223-ac8b-9150b08ed0f5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:49.750929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ba3c82c4-4d66-4223-ac8b-9150b08ed0f5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:49.751670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ba3c82c4-4d66-4223-ac8b-9150b08ed0f5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:49.752119 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ba3c82c4-4d66-4223-ac8b-9150b08ed0f5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:49.752720 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ba3c82c4-4d66-4223-ac8b-9150b08ed0f5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:49.803710 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=100 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:49.949354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-ba3c82c4-4d66-4223-ac8b-9150b08ed0f5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:49.958395 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-ba3c82c4-4d66-4223-ac8b-9150b08ed0f5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:49.962995 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-ba3c82c4-4d66-4223-ac8b-9150b08ed0f5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:49.964300 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-ba3c82c4-4d66-4223-ac8b-9150b08ed0f5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1738 microversion: 2.20 time: 0.229621 Sep 05 12:31:49.964869 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 192/381] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:49 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:50.053662 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-2a9c1bf5-ae6c-4010-9257-42d16533bf19 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:50.054280 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-2a9c1bf5-ae6c-4010-9257-42d16533bf19 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:50.061291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2a9c1bf5-ae6c-4010-9257-42d16533bf19 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:50.061771 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2a9c1bf5-ae6c-4010-9257-42d16533bf19 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:50.062200 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2a9c1bf5-ae6c-4010-9257-42d16533bf19 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:50.062896 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2a9c1bf5-ae6c-4010-9257-42d16533bf19 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:50.063347 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2a9c1bf5-ae6c-4010-9257-42d16533bf19 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:50.063791 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2a9c1bf5-ae6c-4010-9257-42d16533bf19 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:50.114284 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ea7b0c89-2339-4673-9834-27a60e5da0bb tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:50.115014 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-ea7b0c89-2339-4673-9834-27a60e5da0bb tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:50.137982 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ea7b0c89-2339-4673-9834-27a60e5da0bb tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:50.137982 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ea7b0c89-2339-4673-9834-27a60e5da0bb tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:50.137982 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ea7b0c89-2339-4673-9834-27a60e5da0bb tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:50.137982 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ea7b0c89-2339-4673-9834-27a60e5da0bb tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:50.139386 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ea7b0c89-2339-4673-9834-27a60e5da0bb tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:50.139386 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ea7b0c89-2339-4673-9834-27a60e5da0bb tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:50.139626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-2a9c1bf5-ae6c-4010-9257-42d16533bf19 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:50.146031 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-2a9c1bf5-ae6c-4010-9257-42d16533bf19 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1304 microversion: 2.1 time: 0.096807 Sep 05 12:31:50.146605 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 190/382] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:50 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:50.260439 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-ea7b0c89-2339-4673-9834-27a60e5da0bb tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:50.269535 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-ea7b0c89-2339-4673-9834-27a60e5da0bb tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1277 microversion: 2.1 time: 0.159167 Sep 05 12:31:50.270303 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 193/383] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:50 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:50.355867 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f0c5ec8b-e9e0-4f42-9ea9-c181306c1485 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:50.356474 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f0c5ec8b-e9e0-4f42-9ea9-c181306c1485 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:50.362582 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f0c5ec8b-e9e0-4f42-9ea9-c181306c1485 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:50.363063 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f0c5ec8b-e9e0-4f42-9ea9-c181306c1485 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:50.363488 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f0c5ec8b-e9e0-4f42-9ea9-c181306c1485 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:50.364204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f0c5ec8b-e9e0-4f42-9ea9-c181306c1485 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:50.364651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f0c5ec8b-e9e0-4f42-9ea9-c181306c1485 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:50.365106 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f0c5ec8b-e9e0-4f42-9ea9-c181306c1485 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:50.496931 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f0c5ec8b-e9e0-4f42-9ea9-c181306c1485 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:50.504726 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f0c5ec8b-e9e0-4f42-9ea9-c181306c1485 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1368 microversion: 2.1 time: 0.153091 Sep 05 12:31:50.505282 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 191/384] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:50 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:50.990664 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-49247c72-b43c-4ca6-acfa-e3ca847ef1c7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:50.991748 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-49247c72-b43c-4ca6-acfa-e3ca847ef1c7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:51.013415 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-49247c72-b43c-4ca6-acfa-e3ca847ef1c7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:51.016886 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-49247c72-b43c-4ca6-acfa-e3ca847ef1c7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:51.017530 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-49247c72-b43c-4ca6-acfa-e3ca847ef1c7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:51.019498 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-49247c72-b43c-4ca6-acfa-e3ca847ef1c7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:51.020167 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-49247c72-b43c-4ca6-acfa-e3ca847ef1c7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:51.024552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-49247c72-b43c-4ca6-acfa-e3ca847ef1c7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:51.182218 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d073632c-0f71-4511-86aa-070413e64e86 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:51.182921 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d073632c-0f71-4511-86aa-070413e64e86 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:51.189726 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d073632c-0f71-4511-86aa-070413e64e86 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:51.190215 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d073632c-0f71-4511-86aa-070413e64e86 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:51.190645 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d073632c-0f71-4511-86aa-070413e64e86 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:51.191563 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d073632c-0f71-4511-86aa-070413e64e86 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:51.192034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d073632c-0f71-4511-86aa-070413e64e86 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:51.192458 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d073632c-0f71-4511-86aa-070413e64e86 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:51.265230 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d073632c-0f71-4511-86aa-070413e64e86 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:51.286157 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d073632c-0f71-4511-86aa-070413e64e86 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1314 microversion: 2.1 time: 0.104706 Sep 05 12:31:51.291701 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 192/385] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:51 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1314 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:51.307566 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0baa7964-8a2f-462b-bee3-94620bbf874e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:51.312311 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0baa7964-8a2f-462b-bee3-94620bbf874e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:51.321796 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0baa7964-8a2f-462b-bee3-94620bbf874e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:51.322309 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0baa7964-8a2f-462b-bee3-94620bbf874e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:51.325454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0baa7964-8a2f-462b-bee3-94620bbf874e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:51.326374 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0baa7964-8a2f-462b-bee3-94620bbf874e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:51.326875 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0baa7964-8a2f-462b-bee3-94620bbf874e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:51.330347 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0baa7964-8a2f-462b-bee3-94620bbf874e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:51.394926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-49247c72-b43c-4ca6-acfa-e3ca847ef1c7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:51.413564 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-49247c72-b43c-4ca6-acfa-e3ca847ef1c7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:51.415975 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-49247c72-b43c-4ca6-acfa-e3ca847ef1c7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:51.421831 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-49247c72-b43c-4ca6-acfa-e3ca847ef1c7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1738 microversion: 2.20 time: 0.434120 Sep 05 12:31:51.435560 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 194/386] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:50 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1738 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:51.528928 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-6bee48ad-449b-4c60-aaac-fddebb6eae02 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:51.529791 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-6bee48ad-449b-4c60-aaac-fddebb6eae02 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:51.538167 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6bee48ad-449b-4c60-aaac-fddebb6eae02 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:51.541274 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6bee48ad-449b-4c60-aaac-fddebb6eae02 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:51.541274 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6bee48ad-449b-4c60-aaac-fddebb6eae02 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:51.541274 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6bee48ad-449b-4c60-aaac-fddebb6eae02 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:51.541274 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6bee48ad-449b-4c60-aaac-fddebb6eae02 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:51.542676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6bee48ad-449b-4c60-aaac-fddebb6eae02 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:51.560566 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0baa7964-8a2f-462b-bee3-94620bbf874e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:51.571287 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0baa7964-8a2f-462b-bee3-94620bbf874e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1265 microversion: 2.1 time: 0.273183 Sep 05 12:31:51.572322 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 193/387] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:51 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1265 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:51.729441 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6bee48ad-449b-4c60-aaac-fddebb6eae02 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:51.742232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-6bee48ad-449b-4c60-aaac-fddebb6eae02 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1368 microversion: 2.1 time: 0.217187 Sep 05 12:31:51.744957 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 195/388] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:51 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:52.312523 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1cae97bd-2fb3-424d-af4f-a604eee8c9dd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:52.315113 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1cae97bd-2fb3-424d-af4f-a604eee8c9dd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:52.328379 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1cae97bd-2fb3-424d-af4f-a604eee8c9dd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:52.329796 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1cae97bd-2fb3-424d-af4f-a604eee8c9dd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:52.331413 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1cae97bd-2fb3-424d-af4f-a604eee8c9dd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:52.332323 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1cae97bd-2fb3-424d-af4f-a604eee8c9dd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:52.333012 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1cae97bd-2fb3-424d-af4f-a604eee8c9dd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:52.333446 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1cae97bd-2fb3-424d-af4f-a604eee8c9dd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:52.453983 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-aad25d40-a205-4006-9330-596820264b77 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:52.454607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-aad25d40-a205-4006-9330-596820264b77 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:52.483840 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aad25d40-a205-4006-9330-596820264b77 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:52.493578 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aad25d40-a205-4006-9330-596820264b77 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:52.498993 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aad25d40-a205-4006-9330-596820264b77 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:52.499817 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aad25d40-a205-4006-9330-596820264b77 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:52.502150 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aad25d40-a205-4006-9330-596820264b77 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:52.508772 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aad25d40-a205-4006-9330-596820264b77 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:52.538961 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1cae97bd-2fb3-424d-af4f-a604eee8c9dd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:52.552583 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1cae97bd-2fb3-424d-af4f-a604eee8c9dd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1370 microversion: 2.1 time: 0.244860 Sep 05 12:31:52.563904 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 194/389] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:52 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1370 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:52.603831 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e25d84e7-1d0f-45cc-9a50-e710d299d4b5 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:52.604712 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e25d84e7-1d0f-45cc-9a50-e710d299d4b5 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:52.623045 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e25d84e7-1d0f-45cc-9a50-e710d299d4b5 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:52.623560 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e25d84e7-1d0f-45cc-9a50-e710d299d4b5 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:52.624175 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e25d84e7-1d0f-45cc-9a50-e710d299d4b5 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:52.625059 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e25d84e7-1d0f-45cc-9a50-e710d299d4b5 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:52.625666 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e25d84e7-1d0f-45cc-9a50-e710d299d4b5 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:52.626242 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e25d84e7-1d0f-45cc-9a50-e710d299d4b5 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:52.738030 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-aad25d40-a205-4006-9330-596820264b77 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:52.749567 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-aad25d40-a205-4006-9330-596820264b77 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:52.751032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-aad25d40-a205-4006-9330-596820264b77 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:52.752272 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-aad25d40-a205-4006-9330-596820264b77 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1738 microversion: 2.20 time: 0.303472 Sep 05 12:31:52.752844 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 196/390] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:52 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1738 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:31:52.774742 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-380b0fa8-8325-4cb6-9cbf-12d80ba80402 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:52.775837 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-380b0fa8-8325-4cb6-9cbf-12d80ba80402 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:52.784302 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-380b0fa8-8325-4cb6-9cbf-12d80ba80402 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:52.785057 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-380b0fa8-8325-4cb6-9cbf-12d80ba80402 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:52.785593 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-380b0fa8-8325-4cb6-9cbf-12d80ba80402 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:52.786438 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-380b0fa8-8325-4cb6-9cbf-12d80ba80402 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:52.787226 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-380b0fa8-8325-4cb6-9cbf-12d80ba80402 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:52.787977 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-380b0fa8-8325-4cb6-9cbf-12d80ba80402 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:52.953825 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e25d84e7-1d0f-45cc-9a50-e710d299d4b5 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:52.969531 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e25d84e7-1d0f-45cc-9a50-e710d299d4b5 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1265 microversion: 2.1 time: 0.374935 Sep 05 12:31:52.971881 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 195/391] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:52 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1265 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:53.031268 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-380b0fa8-8325-4cb6-9cbf-12d80ba80402 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:53.040503 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-380b0fa8-8325-4cb6-9cbf-12d80ba80402 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1368 microversion: 2.1 time: 0.270632 Sep 05 12:31:53.041114 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 197/392] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:52 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1368 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:53.582743 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f549ab78-3349-4171-807f-a5f3e4492be8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:53.583291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f549ab78-3349-4171-807f-a5f3e4492be8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:53.591459 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f549ab78-3349-4171-807f-a5f3e4492be8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:53.591969 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f549ab78-3349-4171-807f-a5f3e4492be8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:53.592407 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f549ab78-3349-4171-807f-a5f3e4492be8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:53.593106 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f549ab78-3349-4171-807f-a5f3e4492be8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:53.593557 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f549ab78-3349-4171-807f-a5f3e4492be8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:53.593976 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f549ab78-3349-4171-807f-a5f3e4492be8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:53.749239 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f549ab78-3349-4171-807f-a5f3e4492be8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:53.758709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f549ab78-3349-4171-807f-a5f3e4492be8 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1370 microversion: 2.1 time: 0.180285 Sep 05 12:31:53.759280 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 196/393] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:53 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:53.783048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-68fccb79-8393-4000-acaf-174f4c62bea2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:53.783681 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-68fccb79-8393-4000-acaf-174f4c62bea2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:53.787370 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=4 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:53.788107 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=26 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:53.791735 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-68fccb79-8393-4000-acaf-174f4c62bea2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:53.792437 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-68fccb79-8393-4000-acaf-174f4c62bea2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:53.793030 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-68fccb79-8393-4000-acaf-174f4c62bea2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:53.793913 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-68fccb79-8393-4000-acaf-174f4c62bea2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:53.795198 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-68fccb79-8393-4000-acaf-174f4c62bea2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:53.795867 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-68fccb79-8393-4000-acaf-174f4c62bea2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:53.951667 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-68fccb79-8393-4000-acaf-174f4c62bea2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:53.960750 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-68fccb79-8393-4000-acaf-174f4c62bea2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:53.962569 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-68fccb79-8393-4000-acaf-174f4c62bea2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:53.963938 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-68fccb79-8393-4000-acaf-174f4c62bea2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1738 microversion: 2.20 time: 0.188993 Sep 05 12:31:53.964728 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 198/394] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:53 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:53.996863 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-74541f58-c982-4a8c-aa0c-03dd4ab554cc tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:53.997490 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-74541f58-c982-4a8c-aa0c-03dd4ab554cc tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:54.003887 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-74541f58-c982-4a8c-aa0c-03dd4ab554cc tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:54.004383 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-74541f58-c982-4a8c-aa0c-03dd4ab554cc tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:54.004826 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-74541f58-c982-4a8c-aa0c-03dd4ab554cc tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:54.005544 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-74541f58-c982-4a8c-aa0c-03dd4ab554cc tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:54.006563 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-74541f58-c982-4a8c-aa0c-03dd4ab554cc tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:54.006997 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-74541f58-c982-4a8c-aa0c-03dd4ab554cc tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:54.071769 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-c5e9d267-0bbc-4ebb-906a-93c74e48c37d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:54.072394 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-c5e9d267-0bbc-4ebb-906a-93c74e48c37d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:54.079196 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c5e9d267-0bbc-4ebb-906a-93c74e48c37d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:54.079794 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c5e9d267-0bbc-4ebb-906a-93c74e48c37d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:54.080236 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c5e9d267-0bbc-4ebb-906a-93c74e48c37d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:54.080953 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c5e9d267-0bbc-4ebb-906a-93c74e48c37d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:54.081406 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c5e9d267-0bbc-4ebb-906a-93c74e48c37d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:54.082022 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c5e9d267-0bbc-4ebb-906a-93c74e48c37d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:54.179578 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-74541f58-c982-4a8c-aa0c-03dd4ab554cc tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:54.189691 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-74541f58-c982-4a8c-aa0c-03dd4ab554cc tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1265 microversion: 2.1 time: 0.195942 Sep 05 12:31:54.209099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 197/395] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:53 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:54.292092 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c5e9d267-0bbc-4ebb-906a-93c74e48c37d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:54.300122 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-c5e9d267-0bbc-4ebb-906a-93c74e48c37d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1368 microversion: 2.1 time: 0.233346 Sep 05 12:31:54.300560 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 199/396] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:54 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:54.786937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1bbe8789-c928-4bb3-add3-219d055d66d2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:54.788168 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1bbe8789-c928-4bb3-add3-219d055d66d2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:54.797692 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1bbe8789-c928-4bb3-add3-219d055d66d2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:54.798178 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1bbe8789-c928-4bb3-add3-219d055d66d2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:54.798608 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1bbe8789-c928-4bb3-add3-219d055d66d2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:54.799309 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1bbe8789-c928-4bb3-add3-219d055d66d2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:54.799943 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1bbe8789-c928-4bb3-add3-219d055d66d2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:54.800369 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1bbe8789-c928-4bb3-add3-219d055d66d2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:54.819218 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=100 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:54.990790 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-fa27a056-4c41-42bb-a629-f4a075555b3f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:54.999429 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-fa27a056-4c41-42bb-a629-f4a075555b3f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:54.999429 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fa27a056-4c41-42bb-a629-f4a075555b3f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:54.999429 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fa27a056-4c41-42bb-a629-f4a075555b3f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:54.999429 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fa27a056-4c41-42bb-a629-f4a075555b3f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:55.000098 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fa27a056-4c41-42bb-a629-f4a075555b3f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:55.000512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fa27a056-4c41-42bb-a629-f4a075555b3f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:55.000966 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fa27a056-4c41-42bb-a629-f4a075555b3f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:55.264628 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-fa27a056-4c41-42bb-a629-f4a075555b3f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:55.281364 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-fa27a056-4c41-42bb-a629-f4a075555b3f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:55.283231 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-fa27a056-4c41-42bb-a629-f4a075555b3f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:55.284709 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-fa27a056-4c41-42bb-a629-f4a075555b3f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1738 microversion: 2.20 time: 0.298017 Sep 05 12:31:55.285520 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 200/397] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:54 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1738 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:31:55.295614 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-be799310-61a8-4e8e-9709-7260bcadad8e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:55.296362 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-be799310-61a8-4e8e-9709-7260bcadad8e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:55.303832 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-be799310-61a8-4e8e-9709-7260bcadad8e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:55.311948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-be799310-61a8-4e8e-9709-7260bcadad8e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:55.312556 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-be799310-61a8-4e8e-9709-7260bcadad8e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:55.315110 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-be799310-61a8-4e8e-9709-7260bcadad8e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:55.315622 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-be799310-61a8-4e8e-9709-7260bcadad8e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:55.316060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-be799310-61a8-4e8e-9709-7260bcadad8e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:55.351034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1bbe8789-c928-4bb3-add3-219d055d66d2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:55.362287 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1bbe8789-c928-4bb3-add3-219d055d66d2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1370 microversion: 2.1 time: 0.579713 Sep 05 12:31:55.366969 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 198/398] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:54 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1370 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:55.386473 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-5b0b8470-3ffa-444e-af33-cdfd733de3e9 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:55.393393 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-5b0b8470-3ffa-444e-af33-cdfd733de3e9 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:55.397612 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5b0b8470-3ffa-444e-af33-cdfd733de3e9 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:55.398544 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5b0b8470-3ffa-444e-af33-cdfd733de3e9 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:55.399339 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5b0b8470-3ffa-444e-af33-cdfd733de3e9 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:55.400399 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5b0b8470-3ffa-444e-af33-cdfd733de3e9 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:55.401031 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5b0b8470-3ffa-444e-af33-cdfd733de3e9 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:55.401498 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5b0b8470-3ffa-444e-af33-cdfd733de3e9 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:55.628405 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-be799310-61a8-4e8e-9709-7260bcadad8e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:55.638644 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-be799310-61a8-4e8e-9709-7260bcadad8e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1265 microversion: 2.1 time: 0.350631 Sep 05 12:31:55.641382 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 201/399] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:55 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1265 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:55.665471 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5b0b8470-3ffa-444e-af33-cdfd733de3e9 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:55.681617 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-5b0b8470-3ffa-444e-af33-cdfd733de3e9 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1368 microversion: 2.1 time: 0.308396 Sep 05 12:31:55.681617 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 199/400] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:55 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1368 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:55.693025 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-ab89fa73-78f1-43dd-8ea6-bab3f490948c req-20a05ee0-2a5c-42a1-b6c3-3d0f99c44e1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c86e0b82-f349-40c6-986b-359cb36a9862", "tag": "66947e6f-24aa-4efc-9fc1-09b650127cb3"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:31:55.716229 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-ab89fa73-78f1-43dd-8ea6-bab3f490948c req-20a05ee0-2a5c-42a1-b6c3-3d0f99c44e1e service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:55.716802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-ab89fa73-78f1-43dd-8ea6-bab3f490948c req-20a05ee0-2a5c-42a1-b6c3-3d0f99c44e1e service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:55.717243 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-ab89fa73-78f1-43dd-8ea6-bab3f490948c req-20a05ee0-2a5c-42a1-b6c3-3d0f99c44e1e service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:55.736933 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-ab89fa73-78f1-43dd-8ea6-bab3f490948c req-20a05ee0-2a5c-42a1-b6c3-3d0f99c44e1e service nova] Creating event network-changed:66947e6f-24aa-4efc-9fc1-09b650127cb3 for instance c86e0b82-f349-40c6-986b-359cb36a9862 on hv-cinder-80135 Sep 05 12:31:55.743151 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-ab89fa73-78f1-43dd-8ea6-bab3f490948c req-20a05ee0-2a5c-42a1-b6c3-3d0f99c44e1e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054073 Sep 05 12:31:55.744779 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 202/401] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:31:56.316783 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-5e7a1f06-d974-4787-9620-71de0d63b728 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:56.317374 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-5e7a1f06-d974-4787-9620-71de0d63b728 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:56.319233 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=2 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:56.336231 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5e7a1f06-d974-4787-9620-71de0d63b728 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:56.340990 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5e7a1f06-d974-4787-9620-71de0d63b728 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:56.340990 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5e7a1f06-d974-4787-9620-71de0d63b728 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:56.340990 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5e7a1f06-d974-4787-9620-71de0d63b728 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:56.340990 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5e7a1f06-d974-4787-9620-71de0d63b728 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:56.341499 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5e7a1f06-d974-4787-9620-71de0d63b728 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:56.395468 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-81b0d8d7-74e9-4111-a276-ce9d6c9dd8a5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:56.397511 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-81b0d8d7-74e9-4111-a276-ce9d6c9dd8a5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:56.411920 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-81b0d8d7-74e9-4111-a276-ce9d6c9dd8a5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:56.415705 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-81b0d8d7-74e9-4111-a276-ce9d6c9dd8a5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:56.416480 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-81b0d8d7-74e9-4111-a276-ce9d6c9dd8a5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:56.418089 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-81b0d8d7-74e9-4111-a276-ce9d6c9dd8a5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:56.422052 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-81b0d8d7-74e9-4111-a276-ce9d6c9dd8a5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:56.422751 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-81b0d8d7-74e9-4111-a276-ce9d6c9dd8a5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:56.750517 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-81b0d8d7-74e9-4111-a276-ce9d6c9dd8a5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:56.751513 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5e7a1f06-d974-4787-9620-71de0d63b728 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:56.761969 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-81b0d8d7-74e9-4111-a276-ce9d6c9dd8a5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1370 microversion: 2.1 time: 0.371291 Sep 05 12:31:56.771402 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5e7a1f06-d974-4787-9620-71de0d63b728 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:56.780076 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 203/402] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:56 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1370 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:56.782470 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5e7a1f06-d974-4787-9620-71de0d63b728 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:56.793551 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-06ff80c0-3cdd-423d-96ac-5ffd975c369a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:56.795322 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-5e7a1f06-d974-4787-9620-71de0d63b728 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1738 microversion: 2.20 time: 0.483766 Sep 05 12:31:56.796157 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-06ff80c0-3cdd-423d-96ac-5ffd975c369a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:56.798874 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 200/403] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:56 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1738 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:56.810896 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-06ff80c0-3cdd-423d-96ac-5ffd975c369a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:56.824366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-06ff80c0-3cdd-423d-96ac-5ffd975c369a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:56.827248 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-06ff80c0-3cdd-423d-96ac-5ffd975c369a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:56.827248 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-06ff80c0-3cdd-423d-96ac-5ffd975c369a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:56.827248 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-06ff80c0-3cdd-423d-96ac-5ffd975c369a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:56.827248 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-06ff80c0-3cdd-423d-96ac-5ffd975c369a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:56.834819 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-522060e4-5ab6-4851-b2d9-a680efe60229 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:56.834819 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-522060e4-5ab6-4851-b2d9-a680efe60229 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:56.847117 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-522060e4-5ab6-4851-b2d9-a680efe60229 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:56.850202 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-522060e4-5ab6-4851-b2d9-a680efe60229 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:56.850202 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-522060e4-5ab6-4851-b2d9-a680efe60229 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:56.850676 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-522060e4-5ab6-4851-b2d9-a680efe60229 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:56.851963 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-522060e4-5ab6-4851-b2d9-a680efe60229 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:56.853211 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-522060e4-5ab6-4851-b2d9-a680efe60229 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:57.180247 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-06ff80c0-3cdd-423d-96ac-5ffd975c369a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:57.190979 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-06ff80c0-3cdd-423d-96ac-5ffd975c369a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1265 microversion: 2.1 time: 0.409477 Sep 05 12:31:57.211462 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 204/404] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:56 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1265 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:57.452795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-522060e4-5ab6-4851-b2d9-a680efe60229 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:57.469669 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-522060e4-5ab6-4851-b2d9-a680efe60229 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1368 microversion: 2.1 time: 0.655966 Sep 05 12:31:57.470501 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 201/405] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:56 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1368 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:57.801787 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-153fe5ac-797b-4bb4-a085-a78b19725643 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:57.802836 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-153fe5ac-797b-4bb4-a085-a78b19725643 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:57.826156 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-153fe5ac-797b-4bb4-a085-a78b19725643 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:57.838285 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8bb75845-a135-46ad-a4eb-dd9c496aae7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:57.839995 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-8bb75845-a135-46ad-a4eb-dd9c496aae7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:57.843190 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-153fe5ac-797b-4bb4-a085-a78b19725643 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:57.845025 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-153fe5ac-797b-4bb4-a085-a78b19725643 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:57.851564 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-153fe5ac-797b-4bb4-a085-a78b19725643 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:57.852341 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-153fe5ac-797b-4bb4-a085-a78b19725643 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:57.853005 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-153fe5ac-797b-4bb4-a085-a78b19725643 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:57.856281 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8bb75845-a135-46ad-a4eb-dd9c496aae7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:57.856773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8bb75845-a135-46ad-a4eb-dd9c496aae7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:57.857209 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8bb75845-a135-46ad-a4eb-dd9c496aae7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:57.864324 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8bb75845-a135-46ad-a4eb-dd9c496aae7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:57.864874 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8bb75845-a135-46ad-a4eb-dd9c496aae7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:57.865866 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8bb75845-a135-46ad-a4eb-dd9c496aae7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:58.169922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-8bb75845-a135-46ad-a4eb-dd9c496aae7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:58.188496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-8bb75845-a135-46ad-a4eb-dd9c496aae7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:58.190431 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-8bb75845-a135-46ad-a4eb-dd9c496aae7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:58.192026 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-8bb75845-a135-46ad-a4eb-dd9c496aae7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1738 microversion: 2.20 time: 0.360978 Sep 05 12:31:58.192881 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 202/406] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:57 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1738 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:31:58.218544 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-6f9d2f10-7f47-4c30-a88e-862e8b3c9e67 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:58.224123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-6f9d2f10-7f47-4c30-a88e-862e8b3c9e67 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:58.239226 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6f9d2f10-7f47-4c30-a88e-862e8b3c9e67 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:58.240050 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6f9d2f10-7f47-4c30-a88e-862e8b3c9e67 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:58.241546 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6f9d2f10-7f47-4c30-a88e-862e8b3c9e67 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:58.242450 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6f9d2f10-7f47-4c30-a88e-862e8b3c9e67 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:58.257576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6f9d2f10-7f47-4c30-a88e-862e8b3c9e67 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:58.261406 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6f9d2f10-7f47-4c30-a88e-862e8b3c9e67 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:58.644334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-153fe5ac-797b-4bb4-a085-a78b19725643 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:58.679790 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-153fe5ac-797b-4bb4-a085-a78b19725643 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1370 microversion: 2.1 time: 0.868060 Sep 05 12:31:58.679790 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 205/407] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:57 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1370 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:58.703284 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-88f75faa-be61-4dbf-8894-fa37280940b8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:58.714260 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-88f75faa-be61-4dbf-8894-fa37280940b8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:58.735961 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-88f75faa-be61-4dbf-8894-fa37280940b8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:58.737142 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-88f75faa-be61-4dbf-8894-fa37280940b8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:58.740966 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-88f75faa-be61-4dbf-8894-fa37280940b8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:58.742354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-88f75faa-be61-4dbf-8894-fa37280940b8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:58.756061 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-88f75faa-be61-4dbf-8894-fa37280940b8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:58.756787 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-88f75faa-be61-4dbf-8894-fa37280940b8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:59.228645 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6f9d2f10-7f47-4c30-a88e-862e8b3c9e67 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:59.242148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-6f9d2f10-7f47-4c30-a88e-862e8b3c9e67 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1265 microversion: 2.1 time: 1.026216 Sep 05 12:31:59.243847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 203/408] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:58 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1265 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:31:59.260830 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3282e53a-1eda-40c3-a85f-35f7a7f5f8d8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:59.264153 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-3282e53a-1eda-40c3-a85f-35f7a7f5f8d8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:59.273325 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3282e53a-1eda-40c3-a85f-35f7a7f5f8d8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:59.274328 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3282e53a-1eda-40c3-a85f-35f7a7f5f8d8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:59.274973 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3282e53a-1eda-40c3-a85f-35f7a7f5f8d8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:59.279159 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3282e53a-1eda-40c3-a85f-35f7a7f5f8d8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:59.279959 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3282e53a-1eda-40c3-a85f-35f7a7f5f8d8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:59.280627 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3282e53a-1eda-40c3-a85f-35f7a7f5f8d8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:59.372235 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-88f75faa-be61-4dbf-8894-fa37280940b8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:59.393446 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-88f75faa-be61-4dbf-8894-fa37280940b8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1368 microversion: 2.1 time: 0.713254 Sep 05 12:31:59.396439 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 206/409] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:58 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1368 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:31:59.716093 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-f5747d3f-8ad0-4254-9796-ef0c2428ee0e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:31:59.716771 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-f5747d3f-8ad0-4254-9796-ef0c2428ee0e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:31:59.738840 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f5747d3f-8ad0-4254-9796-ef0c2428ee0e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:59.739281 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f5747d3f-8ad0-4254-9796-ef0c2428ee0e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:59.749088 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f5747d3f-8ad0-4254-9796-ef0c2428ee0e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:59.749088 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f5747d3f-8ad0-4254-9796-ef0c2428ee0e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:31:59.749088 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f5747d3f-8ad0-4254-9796-ef0c2428ee0e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:31:59.749088 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f5747d3f-8ad0-4254-9796-ef0c2428ee0e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:31:59.882988 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3282e53a-1eda-40c3-a85f-35f7a7f5f8d8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:59.893332 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3282e53a-1eda-40c3-a85f-35f7a7f5f8d8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:59.900129 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3282e53a-1eda-40c3-a85f-35f7a7f5f8d8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:31:59.903223 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3282e53a-1eda-40c3-a85f-35f7a7f5f8d8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1738 microversion: 2.20 time: 0.656330 Sep 05 12:31:59.921342 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 204/410] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:31:59 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1738 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:00.127042 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f5747d3f-8ad0-4254-9796-ef0c2428ee0e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:00.144306 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-f5747d3f-8ad0-4254-9796-ef0c2428ee0e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1370 microversion: 2.1 time: 0.435190 Sep 05 12:32:00.155869 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 207/411] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:31:59 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1370 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:00.284163 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3e0fc23d-98ce-42b1-b612-4d11fb6a7cd7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:00.286537 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-3e0fc23d-98ce-42b1-b612-4d11fb6a7cd7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:00.294162 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3e0fc23d-98ce-42b1-b612-4d11fb6a7cd7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:00.294839 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3e0fc23d-98ce-42b1-b612-4d11fb6a7cd7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:00.295273 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3e0fc23d-98ce-42b1-b612-4d11fb6a7cd7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:00.296140 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3e0fc23d-98ce-42b1-b612-4d11fb6a7cd7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:00.296745 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3e0fc23d-98ce-42b1-b612-4d11fb6a7cd7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:00.297331 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3e0fc23d-98ce-42b1-b612-4d11fb6a7cd7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:00.417561 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a3f73a4e-e229-4b62-b558-7e04c6c9db8b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:00.418557 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a3f73a4e-e229-4b62-b558-7e04c6c9db8b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:00.424819 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a3f73a4e-e229-4b62-b558-7e04c6c9db8b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:00.425432 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a3f73a4e-e229-4b62-b558-7e04c6c9db8b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:00.426108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a3f73a4e-e229-4b62-b558-7e04c6c9db8b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:00.427078 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a3f73a4e-e229-4b62-b558-7e04c6c9db8b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:00.428353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a3f73a4e-e229-4b62-b558-7e04c6c9db8b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:00.429924 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a3f73a4e-e229-4b62-b558-7e04c6c9db8b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:00.485713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3e0fc23d-98ce-42b1-b612-4d11fb6a7cd7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:00.496346 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3e0fc23d-98ce-42b1-b612-4d11fb6a7cd7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1265 microversion: 2.1 time: 0.217854 Sep 05 12:32:00.497523 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 205/412] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:00 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:00.644329 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a3f73a4e-e229-4b62-b558-7e04c6c9db8b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:00.656261 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a3f73a4e-e229-4b62-b558-7e04c6c9db8b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1368 microversion: 2.1 time: 0.242457 Sep 05 12:32:00.659014 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 208/413] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:00 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1368 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:32:00.939796 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-5d63660a-591a-48cd-aabb-f72373b09de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:00.940422 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-5d63660a-591a-48cd-aabb-f72373b09de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:00.957037 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5d63660a-591a-48cd-aabb-f72373b09de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:00.957832 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5d63660a-591a-48cd-aabb-f72373b09de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:00.958538 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5d63660a-591a-48cd-aabb-f72373b09de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:00.960001 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5d63660a-591a-48cd-aabb-f72373b09de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:00.960641 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5d63660a-591a-48cd-aabb-f72373b09de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:00.961419 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5d63660a-591a-48cd-aabb-f72373b09de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:01.179900 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-87bd454a-d9e3-499d-8844-6328e518f716 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:01.179900 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-87bd454a-d9e3-499d-8844-6328e518f716 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:01.194963 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-87bd454a-d9e3-499d-8844-6328e518f716 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:01.209978 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-87bd454a-d9e3-499d-8844-6328e518f716 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:01.210438 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-87bd454a-d9e3-499d-8844-6328e518f716 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:01.220629 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-87bd454a-d9e3-499d-8844-6328e518f716 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:01.220629 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-87bd454a-d9e3-499d-8844-6328e518f716 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:01.220629 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-87bd454a-d9e3-499d-8844-6328e518f716 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:01.297085 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5d63660a-591a-48cd-aabb-f72373b09de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:01.346737 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5d63660a-591a-48cd-aabb-f72373b09de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:01.358291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5d63660a-591a-48cd-aabb-f72373b09de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:01.361068 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-5d63660a-591a-48cd-aabb-f72373b09de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1738 microversion: 2.20 time: 0.425215 Sep 05 12:32:01.365715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 206/414] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:00 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1738 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:01.492089 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-87bd454a-d9e3-499d-8844-6328e518f716 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:01.500977 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=100 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:01.503953 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-87bd454a-d9e3-499d-8844-6328e518f716 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1370 microversion: 2.1 time: 0.335613 Sep 05 12:32:01.520094 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 209/415] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:01 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1370 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:32:01.528752 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-198fff88-cac0-4b8b-a436-647ef7cdc12b tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:01.530764 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-198fff88-cac0-4b8b-a436-647ef7cdc12b tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:01.541819 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-198fff88-cac0-4b8b-a436-647ef7cdc12b tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:01.543735 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-198fff88-cac0-4b8b-a436-647ef7cdc12b tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:01.544957 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-198fff88-cac0-4b8b-a436-647ef7cdc12b tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:01.546527 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-198fff88-cac0-4b8b-a436-647ef7cdc12b tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:01.547679 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-198fff88-cac0-4b8b-a436-647ef7cdc12b tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:01.548800 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-198fff88-cac0-4b8b-a436-647ef7cdc12b tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:01.577094 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-73832129-9285-48e9-9427-efe7654bc88e req-c7ed18d3-feef-489b-8554-df2b7ab3c023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fac517b0-9cbe-4a6a-8922-21166ec0de63", "name": "network-vif-plugged", "status": "completed", "tag": "d28f89a7-e984-4c77-9cae-fe03a7c5c344"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:01.595179 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-73832129-9285-48e9-9427-efe7654bc88e req-c7ed18d3-feef-489b-8554-df2b7ab3c023 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:01.605826 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-73832129-9285-48e9-9427-efe7654bc88e req-c7ed18d3-feef-489b-8554-df2b7ab3c023 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:01.605826 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-73832129-9285-48e9-9427-efe7654bc88e req-c7ed18d3-feef-489b-8554-df2b7ab3c023 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:01.620975 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-73832129-9285-48e9-9427-efe7654bc88e req-c7ed18d3-feef-489b-8554-df2b7ab3c023 service nova] Creating event network-vif-plugged:d28f89a7-e984-4c77-9cae-fe03a7c5c344 for instance fac517b0-9cbe-4a6a-8922-21166ec0de63 on hv-cinder-80135 Sep 05 12:32:01.631152 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-73832129-9285-48e9-9427-efe7654bc88e req-c7ed18d3-feef-489b-8554-df2b7ab3c023 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057464 Sep 05 12:32:01.632461 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 210/416] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:32:01.689169 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-f730d2be-c66b-4433-bd1a-6f1866a4179c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:01.692343 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-f730d2be-c66b-4433-bd1a-6f1866a4179c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:01.711073 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f730d2be-c66b-4433-bd1a-6f1866a4179c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:01.726715 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f730d2be-c66b-4433-bd1a-6f1866a4179c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:01.727623 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f730d2be-c66b-4433-bd1a-6f1866a4179c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:01.732591 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f730d2be-c66b-4433-bd1a-6f1866a4179c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:01.733347 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f730d2be-c66b-4433-bd1a-6f1866a4179c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:01.734230 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f730d2be-c66b-4433-bd1a-6f1866a4179c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:01.995667 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-198fff88-cac0-4b8b-a436-647ef7cdc12b tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:02.006369 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-198fff88-cac0-4b8b-a436-647ef7cdc12b tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1265 microversion: 2.1 time: 0.480932 Sep 05 12:32:02.010527 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 207/417] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:01 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1265 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:02.145846 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f730d2be-c66b-4433-bd1a-6f1866a4179c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:02.159138 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-f730d2be-c66b-4433-bd1a-6f1866a4179c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1368 microversion: 2.1 time: 0.476941 Sep 05 12:32:02.161042 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 211/418] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:01 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1368 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:02.395522 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-50d06aaf-1de7-4660-af3e-f91746d42cf8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:02.396831 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-50d06aaf-1de7-4660-af3e-f91746d42cf8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:02.403210 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-50d06aaf-1de7-4660-af3e-f91746d42cf8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:02.403964 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-50d06aaf-1de7-4660-af3e-f91746d42cf8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:02.404402 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-50d06aaf-1de7-4660-af3e-f91746d42cf8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:02.405315 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-50d06aaf-1de7-4660-af3e-f91746d42cf8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:02.405773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-50d06aaf-1de7-4660-af3e-f91746d42cf8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:02.406395 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-50d06aaf-1de7-4660-af3e-f91746d42cf8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:02.526719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a54340c3-9079-4d86-9709-221ee37e4bff tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:02.528527 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a54340c3-9079-4d86-9709-221ee37e4bff tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:02.536068 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a54340c3-9079-4d86-9709-221ee37e4bff tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:02.536926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a54340c3-9079-4d86-9709-221ee37e4bff tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:02.537620 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a54340c3-9079-4d86-9709-221ee37e4bff tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:02.538820 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a54340c3-9079-4d86-9709-221ee37e4bff tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:02.540405 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a54340c3-9079-4d86-9709-221ee37e4bff tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:02.541297 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a54340c3-9079-4d86-9709-221ee37e4bff tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:02.854903 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-50d06aaf-1de7-4660-af3e-f91746d42cf8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:02.864829 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-50d06aaf-1de7-4660-af3e-f91746d42cf8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:02.867981 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-50d06aaf-1de7-4660-af3e-f91746d42cf8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:02.869713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-50d06aaf-1de7-4660-af3e-f91746d42cf8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1738 microversion: 2.20 time: 0.477994 Sep 05 12:32:02.870500 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 208/419] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:02 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1738 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:03.039214 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-09dd03ff-ac49-47d2-9a77-ad3251a2725a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:03.040231 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-09dd03ff-ac49-47d2-9a77-ad3251a2725a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:03.056878 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-09dd03ff-ac49-47d2-9a77-ad3251a2725a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:03.057388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-09dd03ff-ac49-47d2-9a77-ad3251a2725a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:03.057836 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-09dd03ff-ac49-47d2-9a77-ad3251a2725a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:03.058579 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-09dd03ff-ac49-47d2-9a77-ad3251a2725a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:03.059048 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-09dd03ff-ac49-47d2-9a77-ad3251a2725a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:03.059483 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-09dd03ff-ac49-47d2-9a77-ad3251a2725a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:03.124205 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a54340c3-9079-4d86-9709-221ee37e4bff tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:03.138963 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a54340c3-9079-4d86-9709-221ee37e4bff tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1370 microversion: 2.1 time: 0.616306 Sep 05 12:32:03.140135 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 212/420] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:02 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1370 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:32:03.193598 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-bc67a70c-c8c7-431e-a177-2bd225755ccb tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:03.196831 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-bc67a70c-c8c7-431e-a177-2bd225755ccb tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:03.220076 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bc67a70c-c8c7-431e-a177-2bd225755ccb tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:03.221046 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bc67a70c-c8c7-431e-a177-2bd225755ccb tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:03.222403 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bc67a70c-c8c7-431e-a177-2bd225755ccb tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:03.224031 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bc67a70c-c8c7-431e-a177-2bd225755ccb tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:03.227771 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bc67a70c-c8c7-431e-a177-2bd225755ccb tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:03.233592 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bc67a70c-c8c7-431e-a177-2bd225755ccb tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:03.438082 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-09dd03ff-ac49-47d2-9a77-ad3251a2725a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:03.447290 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-09dd03ff-ac49-47d2-9a77-ad3251a2725a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1265 microversion: 2.1 time: 0.412543 Sep 05 12:32:03.452081 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 209/421] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:03 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1265 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:32:03.685161 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-bc67a70c-c8c7-431e-a177-2bd225755ccb tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:03.707011 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-bc67a70c-c8c7-431e-a177-2bd225755ccb tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1368 microversion: 2.1 time: 0.527625 Sep 05 12:32:03.721960 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 213/422] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:03 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1368 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:03.896195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d4ee2fa8-772c-47f8-a541-1cfc555d656e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:03.899142 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d4ee2fa8-772c-47f8-a541-1cfc555d656e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:03.907335 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d4ee2fa8-772c-47f8-a541-1cfc555d656e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:03.907859 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d4ee2fa8-772c-47f8-a541-1cfc555d656e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:03.908301 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d4ee2fa8-772c-47f8-a541-1cfc555d656e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:03.909221 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d4ee2fa8-772c-47f8-a541-1cfc555d656e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:03.909869 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d4ee2fa8-772c-47f8-a541-1cfc555d656e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:03.910305 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d4ee2fa8-772c-47f8-a541-1cfc555d656e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:04.156539 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d4ee2fa8-772c-47f8-a541-1cfc555d656e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:04.164038 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-243f30e2-0715-4e86-ad1f-32cca10fd209 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:04.164962 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-243f30e2-0715-4e86-ad1f-32cca10fd209 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:04.166111 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d4ee2fa8-772c-47f8-a541-1cfc555d656e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:04.167881 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d4ee2fa8-772c-47f8-a541-1cfc555d656e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:04.169337 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d4ee2fa8-772c-47f8-a541-1cfc555d656e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1738 microversion: 2.20 time: 0.277075 Sep 05 12:32:04.169902 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 210/423] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:03 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1738 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:04.174615 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-243f30e2-0715-4e86-ad1f-32cca10fd209 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:04.175942 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-243f30e2-0715-4e86-ad1f-32cca10fd209 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:04.177782 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-243f30e2-0715-4e86-ad1f-32cca10fd209 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:04.179172 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-243f30e2-0715-4e86-ad1f-32cca10fd209 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:04.179882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-243f30e2-0715-4e86-ad1f-32cca10fd209 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:04.180535 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-243f30e2-0715-4e86-ad1f-32cca10fd209 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:04.355708 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-243f30e2-0715-4e86-ad1f-32cca10fd209 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:04.365108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-243f30e2-0715-4e86-ad1f-32cca10fd209 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1370 microversion: 2.1 time: 0.206452 Sep 05 12:32:04.366015 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 214/424] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:04 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:32:04.473915 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d982cc4e-4e50-44cd-bbdf-96144f2c2d16 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:04.476237 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d982cc4e-4e50-44cd-bbdf-96144f2c2d16 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:04.492390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d982cc4e-4e50-44cd-bbdf-96144f2c2d16 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:04.499154 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d982cc4e-4e50-44cd-bbdf-96144f2c2d16 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:04.500979 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d982cc4e-4e50-44cd-bbdf-96144f2c2d16 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:04.502495 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d982cc4e-4e50-44cd-bbdf-96144f2c2d16 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:04.507650 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d982cc4e-4e50-44cd-bbdf-96144f2c2d16 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:04.509928 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d982cc4e-4e50-44cd-bbdf-96144f2c2d16 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:04.734715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d982cc4e-4e50-44cd-bbdf-96144f2c2d16 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:04.744815 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d982cc4e-4e50-44cd-bbdf-96144f2c2d16 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1265 microversion: 2.1 time: 0.275532 Sep 05 12:32:04.759571 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d34021a8-c0ff-4b67-a914-07944a1e2124 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:04.760122 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 211/425] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:04 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1265 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:04.760246 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d34021a8-c0ff-4b67-a914-07944a1e2124 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:04.762706 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d34021a8-c0ff-4b67-a914-07944a1e2124 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:04.763194 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d34021a8-c0ff-4b67-a914-07944a1e2124 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:04.763662 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d34021a8-c0ff-4b67-a914-07944a1e2124 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:04.767251 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d34021a8-c0ff-4b67-a914-07944a1e2124 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:04.767251 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d34021a8-c0ff-4b67-a914-07944a1e2124 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:04.767251 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d34021a8-c0ff-4b67-a914-07944a1e2124 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:04.969258 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d34021a8-c0ff-4b67-a914-07944a1e2124 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:04.978818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d34021a8-c0ff-4b67-a914-07944a1e2124 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1368 microversion: 2.1 time: 0.230797 Sep 05 12:32:04.979435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 215/426] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:04 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:05.205139 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a06b182d-d25a-4952-828c-6839a6d49a00 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:05.205837 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a06b182d-d25a-4952-828c-6839a6d49a00 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:05.232211 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a06b182d-d25a-4952-828c-6839a6d49a00 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:05.234129 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a06b182d-d25a-4952-828c-6839a6d49a00 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:05.235606 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a06b182d-d25a-4952-828c-6839a6d49a00 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:05.238279 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a06b182d-d25a-4952-828c-6839a6d49a00 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:05.239100 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a06b182d-d25a-4952-828c-6839a6d49a00 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:05.239735 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a06b182d-d25a-4952-828c-6839a6d49a00 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:05.390949 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-24050b19-9b53-453d-98c3-657c8d5cb55b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:05.391729 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-24050b19-9b53-453d-98c3-657c8d5cb55b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:05.405700 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-24050b19-9b53-453d-98c3-657c8d5cb55b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:05.406314 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-24050b19-9b53-453d-98c3-657c8d5cb55b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:05.406830 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-24050b19-9b53-453d-98c3-657c8d5cb55b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:05.409315 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-24050b19-9b53-453d-98c3-657c8d5cb55b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:05.409889 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-24050b19-9b53-453d-98c3-657c8d5cb55b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:05.414175 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-24050b19-9b53-453d-98c3-657c8d5cb55b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:05.545014 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a06b182d-d25a-4952-828c-6839a6d49a00 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:05.558426 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a06b182d-d25a-4952-828c-6839a6d49a00 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:05.558426 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a06b182d-d25a-4952-828c-6839a6d49a00 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:05.558426 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a06b182d-d25a-4952-828c-6839a6d49a00 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1738 microversion: 2.20 time: 0.363186 Sep 05 12:32:05.565033 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 212/427] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:05 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1738 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:05.570623 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-a24576db-23d8-419d-84bf-5b5cf7db60a8 req-45a7937a-53df-493f-81d5-e1138009b673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c86e0b82-f349-40c6-986b-359cb36a9862", "name": "network-vif-plugged", "status": "completed", "tag": "66947e6f-24aa-4efc-9fc1-09b650127cb3"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:05.594687 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-a24576db-23d8-419d-84bf-5b5cf7db60a8 req-45a7937a-53df-493f-81d5-e1138009b673 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:05.595652 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-a24576db-23d8-419d-84bf-5b5cf7db60a8 req-45a7937a-53df-493f-81d5-e1138009b673 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:05.596656 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-a24576db-23d8-419d-84bf-5b5cf7db60a8 req-45a7937a-53df-493f-81d5-e1138009b673 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:05.613053 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-a24576db-23d8-419d-84bf-5b5cf7db60a8 req-45a7937a-53df-493f-81d5-e1138009b673 service nova] Creating event network-vif-plugged:66947e6f-24aa-4efc-9fc1-09b650127cb3 for instance c86e0b82-f349-40c6-986b-359cb36a9862 on hv-cinder-80135 Sep 05 12:32:05.620608 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-a24576db-23d8-419d-84bf-5b5cf7db60a8 req-45a7937a-53df-493f-81d5-e1138009b673 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054041 Sep 05 12:32:05.622011 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 213/428] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:32:05.711439 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-24050b19-9b53-453d-98c3-657c8d5cb55b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:05.721520 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-24050b19-9b53-453d-98c3-657c8d5cb55b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1370 microversion: 2.1 time: 0.335602 Sep 05 12:32:05.724132 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 216/429] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:05 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1370 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:05.775363 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-877a8d53-a975-4428-bd2e-02311c3e4009 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:05.776303 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-877a8d53-a975-4428-bd2e-02311c3e4009 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:05.784012 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-877a8d53-a975-4428-bd2e-02311c3e4009 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:05.784747 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-877a8d53-a975-4428-bd2e-02311c3e4009 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:05.785354 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-877a8d53-a975-4428-bd2e-02311c3e4009 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:05.786409 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-877a8d53-a975-4428-bd2e-02311c3e4009 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:05.787098 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-877a8d53-a975-4428-bd2e-02311c3e4009 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:05.787928 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-877a8d53-a975-4428-bd2e-02311c3e4009 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:06.003331 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-c90e0c9b-3753-4f0f-aed2-53b945d2f0da tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:06.004002 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-877a8d53-a975-4428-bd2e-02311c3e4009 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:06.004976 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-c90e0c9b-3753-4f0f-aed2-53b945d2f0da tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:06.014147 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:06.016369 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-877a8d53-a975-4428-bd2e-02311c3e4009 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1265 microversion: 2.1 time: 0.247482 Sep 05 12:32:06.017844 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 214/430] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:05 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:06.027057 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c90e0c9b-3753-4f0f-aed2-53b945d2f0da tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:06.027890 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c90e0c9b-3753-4f0f-aed2-53b945d2f0da tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:06.028520 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c90e0c9b-3753-4f0f-aed2-53b945d2f0da tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:06.031574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c90e0c9b-3753-4f0f-aed2-53b945d2f0da tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:06.032276 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c90e0c9b-3753-4f0f-aed2-53b945d2f0da tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:06.034016 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c90e0c9b-3753-4f0f-aed2-53b945d2f0da tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:06.222242 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c90e0c9b-3753-4f0f-aed2-53b945d2f0da tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:06.235330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-c90e0c9b-3753-4f0f-aed2-53b945d2f0da tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1368 microversion: 2.1 time: 0.235531 Sep 05 12:32:06.236507 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 217/431] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:05 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:06.583463 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-605a82ad-db8a-4621-ac90-e6779c7d53c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:06.584755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-605a82ad-db8a-4621-ac90-e6779c7d53c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:06.596717 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-605a82ad-db8a-4621-ac90-e6779c7d53c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:06.598065 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-605a82ad-db8a-4621-ac90-e6779c7d53c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:06.599094 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-605a82ad-db8a-4621-ac90-e6779c7d53c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:06.601108 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-605a82ad-db8a-4621-ac90-e6779c7d53c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:06.601884 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-605a82ad-db8a-4621-ac90-e6779c7d53c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:06.602562 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-605a82ad-db8a-4621-ac90-e6779c7d53c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:06.754097 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-8a0f953c-7e98-4037-896e-04e6d4ce7d85 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:06.754097 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-8a0f953c-7e98-4037-896e-04e6d4ce7d85 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:06.769815 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8a0f953c-7e98-4037-896e-04e6d4ce7d85 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:06.770312 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8a0f953c-7e98-4037-896e-04e6d4ce7d85 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:06.770745 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8a0f953c-7e98-4037-896e-04e6d4ce7d85 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:06.780960 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8a0f953c-7e98-4037-896e-04e6d4ce7d85 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:06.783872 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8a0f953c-7e98-4037-896e-04e6d4ce7d85 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:06.784602 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8a0f953c-7e98-4037-896e-04e6d4ce7d85 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:06.848272 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-605a82ad-db8a-4621-ac90-e6779c7d53c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:06.861309 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=100 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:06.865379 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-605a82ad-db8a-4621-ac90-e6779c7d53c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:06.867058 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-605a82ad-db8a-4621-ac90-e6779c7d53c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:06.868564 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-605a82ad-db8a-4621-ac90-e6779c7d53c5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1738 microversion: 2.20 time: 0.288986 Sep 05 12:32:06.869583 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 215/432] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:06 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1738 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:07.012350 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-8a0f953c-7e98-4037-896e-04e6d4ce7d85 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:07.022542 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-8a0f953c-7e98-4037-896e-04e6d4ce7d85 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1370 microversion: 2.1 time: 0.280847 Sep 05 12:32:07.023111 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 218/433] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:06 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1370 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:32:07.056110 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a87319d2-ed7f-4ea5-a879-8b2ea1ef44a0 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:07.056720 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a87319d2-ed7f-4ea5-a879-8b2ea1ef44a0 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:07.064134 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a87319d2-ed7f-4ea5-a879-8b2ea1ef44a0 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:07.072198 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a87319d2-ed7f-4ea5-a879-8b2ea1ef44a0 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:07.073157 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a87319d2-ed7f-4ea5-a879-8b2ea1ef44a0 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:07.074257 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a87319d2-ed7f-4ea5-a879-8b2ea1ef44a0 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:07.074722 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a87319d2-ed7f-4ea5-a879-8b2ea1ef44a0 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:07.075179 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a87319d2-ed7f-4ea5-a879-8b2ea1ef44a0 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:07.268245 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-83852d6d-c146-4ce4-af5e-9cfb8c4d7ae4 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:07.268881 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-83852d6d-c146-4ce4-af5e-9cfb8c4d7ae4 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:07.282920 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-83852d6d-c146-4ce4-af5e-9cfb8c4d7ae4 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:07.288448 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-83852d6d-c146-4ce4-af5e-9cfb8c4d7ae4 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:07.292069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-83852d6d-c146-4ce4-af5e-9cfb8c4d7ae4 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:07.293146 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-83852d6d-c146-4ce4-af5e-9cfb8c4d7ae4 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:07.293852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-83852d6d-c146-4ce4-af5e-9cfb8c4d7ae4 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:07.295272 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-83852d6d-c146-4ce4-af5e-9cfb8c4d7ae4 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:07.342517 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a87319d2-ed7f-4ea5-a879-8b2ea1ef44a0 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:07.350910 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a87319d2-ed7f-4ea5-a879-8b2ea1ef44a0 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1265 microversion: 2.1 time: 0.308492 Sep 05 12:32:07.371766 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 216/434] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:07 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1265 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:07.525194 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-83852d6d-c146-4ce4-af5e-9cfb8c4d7ae4 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:07.535365 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-83852d6d-c146-4ce4-af5e-9cfb8c4d7ae4 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1368 microversion: 2.1 time: 0.280809 Sep 05 12:32:07.537662 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 219/435] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:07 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1368 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:07.905760 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-fa8efa50-756e-4be5-a0dd-2d120f55d583 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:07.906524 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-fa8efa50-756e-4be5-a0dd-2d120f55d583 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:07.921685 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fa8efa50-756e-4be5-a0dd-2d120f55d583 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:07.922196 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fa8efa50-756e-4be5-a0dd-2d120f55d583 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:07.922631 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fa8efa50-756e-4be5-a0dd-2d120f55d583 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:07.923353 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fa8efa50-756e-4be5-a0dd-2d120f55d583 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:07.923838 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fa8efa50-756e-4be5-a0dd-2d120f55d583 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:07.924352 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fa8efa50-756e-4be5-a0dd-2d120f55d583 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:08.048614 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-10cfb9c9-44db-4522-9e23-65ebd8577954 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:08.064343 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-10cfb9c9-44db-4522-9e23-65ebd8577954 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:08.087047 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-10cfb9c9-44db-4522-9e23-65ebd8577954 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:08.090207 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-10cfb9c9-44db-4522-9e23-65ebd8577954 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:08.093573 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-10cfb9c9-44db-4522-9e23-65ebd8577954 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:08.099126 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-10cfb9c9-44db-4522-9e23-65ebd8577954 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:08.099126 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-10cfb9c9-44db-4522-9e23-65ebd8577954 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:08.099126 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-10cfb9c9-44db-4522-9e23-65ebd8577954 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:08.192814 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-fa8efa50-756e-4be5-a0dd-2d120f55d583 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:08.205007 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-fa8efa50-756e-4be5-a0dd-2d120f55d583 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:08.207237 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-fa8efa50-756e-4be5-a0dd-2d120f55d583 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:08.208747 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-fa8efa50-756e-4be5-a0dd-2d120f55d583 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1738 microversion: 2.20 time: 0.307278 Sep 05 12:32:08.210640 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 217/436] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:07 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1738 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:08.357788 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-10cfb9c9-44db-4522-9e23-65ebd8577954 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:08.369728 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-10cfb9c9-44db-4522-9e23-65ebd8577954 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1370 microversion: 2.1 time: 0.325342 Sep 05 12:32:08.370387 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 220/437] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:08 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1370 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:08.382674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8d2b2305-a1f4-4329-819c-713530fc55ba tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:08.383370 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-8d2b2305-a1f4-4329-819c-713530fc55ba tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:08.390094 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8d2b2305-a1f4-4329-819c-713530fc55ba tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:08.390784 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8d2b2305-a1f4-4329-819c-713530fc55ba tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:08.391522 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8d2b2305-a1f4-4329-819c-713530fc55ba tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:08.392401 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8d2b2305-a1f4-4329-819c-713530fc55ba tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:08.395478 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8d2b2305-a1f4-4329-819c-713530fc55ba tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:08.395478 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8d2b2305-a1f4-4329-819c-713530fc55ba tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:08.561031 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-9bb139af-6605-46fb-a3ec-51dae595734c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:08.561962 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-9bb139af-6605-46fb-a3ec-51dae595734c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:08.569152 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9bb139af-6605-46fb-a3ec-51dae595734c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:08.569867 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9bb139af-6605-46fb-a3ec-51dae595734c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:08.570497 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9bb139af-6605-46fb-a3ec-51dae595734c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:08.571408 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9bb139af-6605-46fb-a3ec-51dae595734c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:08.571976 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9bb139af-6605-46fb-a3ec-51dae595734c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:08.572403 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9bb139af-6605-46fb-a3ec-51dae595734c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:08.576483 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-8d2b2305-a1f4-4329-819c-713530fc55ba tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:08.584372 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-8d2b2305-a1f4-4329-819c-713530fc55ba tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1265 microversion: 2.1 time: 0.207187 Sep 05 12:32:08.588172 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 218/438] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:08 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:08.765457 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-9bb139af-6605-46fb-a3ec-51dae595734c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:08.786800 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-9bb139af-6605-46fb-a3ec-51dae595734c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1368 microversion: 2.1 time: 0.229465 Sep 05 12:32:08.788255 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 221/439] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:08 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:32:09.243395 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-154bac1d-d6f3-42e1-9661-c5902964ba83 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:09.244087 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-154bac1d-d6f3-42e1-9661-c5902964ba83 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:09.256750 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-154bac1d-d6f3-42e1-9661-c5902964ba83 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:09.256750 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-154bac1d-d6f3-42e1-9661-c5902964ba83 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:09.256750 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-154bac1d-d6f3-42e1-9661-c5902964ba83 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:09.256750 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-154bac1d-d6f3-42e1-9661-c5902964ba83 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:09.257073 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-154bac1d-d6f3-42e1-9661-c5902964ba83 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:09.257073 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-154bac1d-d6f3-42e1-9661-c5902964ba83 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:09.394896 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-416b0332-9f02-4c2b-815a-ce8da507a117 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:09.396303 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-416b0332-9f02-4c2b-815a-ce8da507a117 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:09.414681 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-416b0332-9f02-4c2b-815a-ce8da507a117 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:09.420643 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-416b0332-9f02-4c2b-815a-ce8da507a117 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:09.421895 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-416b0332-9f02-4c2b-815a-ce8da507a117 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:09.422776 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-416b0332-9f02-4c2b-815a-ce8da507a117 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:09.423091 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-416b0332-9f02-4c2b-815a-ce8da507a117 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:09.424074 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-416b0332-9f02-4c2b-815a-ce8da507a117 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:09.569877 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-154bac1d-d6f3-42e1-9661-c5902964ba83 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:09.578989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-154bac1d-d6f3-42e1-9661-c5902964ba83 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:09.580606 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-154bac1d-d6f3-42e1-9661-c5902964ba83 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:09.581922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-154bac1d-d6f3-42e1-9661-c5902964ba83 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1720 microversion: 2.20 time: 0.348339 Sep 05 12:32:09.582529 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 219/440] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:09 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1720 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:32:09.587863 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4633ecbb-650b-4f5a-b852-d1d82d0eaa03 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-741598888", "imageRef": "7844cf5b-4975-4cb9-a7f8-31cc5e52098a", "flavorRef": "452"}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:09.624505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-416b0332-9f02-4c2b-815a-ce8da507a117 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:09.632960 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-416b0332-9f02-4c2b-815a-ce8da507a117 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1370 microversion: 2.1 time: 0.242553 Sep 05 12:32:09.650739 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 222/441] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:09 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:09.650739 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-0cfffc39-c3c4-4cb7-a8a1-d586a979fa33 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:09.650739 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-0cfffc39-c3c4-4cb7-a8a1-d586a979fa33 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:09.650739 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0cfffc39-c3c4-4cb7-a8a1-d586a979fa33 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:09.650739 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0cfffc39-c3c4-4cb7-a8a1-d586a979fa33 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:09.652501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0cfffc39-c3c4-4cb7-a8a1-d586a979fa33 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:09.652501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0cfffc39-c3c4-4cb7-a8a1-d586a979fa33 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:09.652801 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.network.neutron [None req-4633ecbb-650b-4f5a-b852-d1d82d0eaa03 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] validate_networks() for None {{(pid=121211) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:32:09.652965 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0cfffc39-c3c4-4cb7-a8a1-d586a979fa33 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:09.652965 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0cfffc39-c3c4-4cb7-a8a1-d586a979fa33 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:09.869478 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-0cfffc39-c3c4-4cb7-a8a1-d586a979fa33 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:09.879903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-0cfffc39-c3c4-4cb7-a8a1-d586a979fa33 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1265 microversion: 2.1 time: 0.244332 Sep 05 12:32:09.881049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 223/442] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:09 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:09.887365 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-2ba0072d-12b8-4da6-9b5b-a38f846dccce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:09.888230 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-2ba0072d-12b8-4da6-9b5b-a38f846dccce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:09.898073 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2ba0072d-12b8-4da6-9b5b-a38f846dccce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:09.903189 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2ba0072d-12b8-4da6-9b5b-a38f846dccce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:09.903189 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2ba0072d-12b8-4da6-9b5b-a38f846dccce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:09.903189 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2ba0072d-12b8-4da6-9b5b-a38f846dccce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:09.903189 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2ba0072d-12b8-4da6-9b5b-a38f846dccce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:09.903641 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2ba0072d-12b8-4da6-9b5b-a38f846dccce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:10.098584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-4633ecbb-650b-4f5a-b852-d1d82d0eaa03 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Flavor limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:32:10.099182 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-4633ecbb-650b-4f5a-b852-d1d82d0eaa03 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Image limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:32:10.099777 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-4633ecbb-650b-4f5a-b852-d1d82d0eaa03 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Flavor pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:32:10.100275 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-4633ecbb-650b-4f5a-b852-d1d82d0eaa03 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Image pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:32:10.100744 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-4633ecbb-650b-4f5a-b852-d1d82d0eaa03 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:32:10.103439 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=100 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:10.112642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4633ecbb-650b-4f5a-b852-d1d82d0eaa03 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:10.113409 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4633ecbb-650b-4f5a-b852-d1d82d0eaa03 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:10.113853 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4633ecbb-650b-4f5a-b852-d1d82d0eaa03 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:10.114620 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4633ecbb-650b-4f5a-b852-d1d82d0eaa03 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:10.115060 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4633ecbb-650b-4f5a-b852-d1d82d0eaa03 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:10.115526 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4633ecbb-650b-4f5a-b852-d1d82d0eaa03 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:10.137931 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-4633ecbb-650b-4f5a-b852-d1d82d0eaa03 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Getting quotas for project 29ac989524a34d65bcefc990244d02dd. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:32:10.144092 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-4633ecbb-650b-4f5a-b852-d1d82d0eaa03 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Getting quotas for user d86ccae798764807976ab6c52b5f50a7 and project 29ac989524a34d65bcefc990244d02dd. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:32:10.216322 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4633ecbb-650b-4f5a-b852-d1d82d0eaa03 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Going to run 1 instances... {{(pid=121211) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:32:10.232383 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4633ecbb-650b-4f5a-b852-d1d82d0eaa03 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7844cf5b-4975-4cb9-a7f8-31cc5e52098a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121211) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:32:10.279399 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-2ba0072d-12b8-4da6-9b5b-a38f846dccce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:10.317397 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-2ba0072d-12b8-4da6-9b5b-a38f846dccce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1368 microversion: 2.1 time: 0.434932 Sep 05 12:32:10.319086 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 224/443] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:09 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1368 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:10.490656 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4633ecbb-650b-4f5a-b852-d1d82d0eaa03 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.906751 Sep 05 12:32:10.492668 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 220/444] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Sep 5 12:32:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:32:10.508383 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e3bcda3d-cecd-48e1-a58d-158a547cea15 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:10.509339 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-e3bcda3d-cecd-48e1-a58d-158a547cea15 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:10.597273 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-e3bcda3d-cecd-48e1-a58d-158a547cea15 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:10.611637 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a5dd8cdd-81a9-4712-b49a-bbb9ce89dfce tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:10.614310 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a5dd8cdd-81a9-4712-b49a-bbb9ce89dfce tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:10.620758 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-e3bcda3d-cecd-48e1-a58d-158a547cea15 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1214 microversion: 2.1 time: 0.120466 Sep 05 12:32:10.640801 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 225/445] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:10 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:10.641199 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a5dd8cdd-81a9-4712-b49a-bbb9ce89dfce tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:10.642246 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a5dd8cdd-81a9-4712-b49a-bbb9ce89dfce tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:10.642964 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a5dd8cdd-81a9-4712-b49a-bbb9ce89dfce tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:10.643965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a5dd8cdd-81a9-4712-b49a-bbb9ce89dfce tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:10.644665 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a5dd8cdd-81a9-4712-b49a-bbb9ce89dfce tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:10.645320 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a5dd8cdd-81a9-4712-b49a-bbb9ce89dfce tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:10.659771 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a10ed132-1cd8-4629-8650-dfacceb99bbe tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:10.660766 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a10ed132-1cd8-4629-8650-dfacceb99bbe tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:10.673694 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a10ed132-1cd8-4629-8650-dfacceb99bbe tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:10.677366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a10ed132-1cd8-4629-8650-dfacceb99bbe tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:10.678071 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a10ed132-1cd8-4629-8650-dfacceb99bbe tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:10.682560 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a10ed132-1cd8-4629-8650-dfacceb99bbe tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:10.684219 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a10ed132-1cd8-4629-8650-dfacceb99bbe tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:10.687424 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a10ed132-1cd8-4629-8650-dfacceb99bbe tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:10.884616 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a5dd8cdd-81a9-4712-b49a-bbb9ce89dfce tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:10.895782 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a5dd8cdd-81a9-4712-b49a-bbb9ce89dfce tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:10.898235 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a5dd8cdd-81a9-4712-b49a-bbb9ce89dfce tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:10.900078 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a5dd8cdd-81a9-4712-b49a-bbb9ce89dfce tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1720 microversion: 2.20 time: 0.292382 Sep 05 12:32:10.918416 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 221/446] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:10 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1720 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:10.930762 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4a0cbc61-1f09-4ea2-aebb-e73c3b4385e4 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:10.931868 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4a0cbc61-1f09-4ea2-aebb-e73c3b4385e4 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:10.939458 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a10ed132-1cd8-4629-8650-dfacceb99bbe tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:10.941735 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a0cbc61-1f09-4ea2-aebb-e73c3b4385e4 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:10.942414 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a0cbc61-1f09-4ea2-aebb-e73c3b4385e4 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:10.943035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a0cbc61-1f09-4ea2-aebb-e73c3b4385e4 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:10.944583 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a0cbc61-1f09-4ea2-aebb-e73c3b4385e4 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:10.945195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a0cbc61-1f09-4ea2-aebb-e73c3b4385e4 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:10.945771 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a0cbc61-1f09-4ea2-aebb-e73c3b4385e4 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:10.954422 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a10ed132-1cd8-4629-8650-dfacceb99bbe tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1370 microversion: 2.1 time: 0.299270 Sep 05 12:32:10.962156 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 226/447] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:10 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1370 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:11.153496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-4a0cbc61-1f09-4ea2-aebb-e73c3b4385e4 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:11.168819 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4a0cbc61-1f09-4ea2-aebb-e73c3b4385e4 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1265 microversion: 2.1 time: 0.248907 Sep 05 12:32:11.172980 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 222/448] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:10 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:11.343474 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-11ea4397-3648-4e8e-ae34-cec7f81e3d38 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:11.344123 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-11ea4397-3648-4e8e-ae34-cec7f81e3d38 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:11.351086 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-11ea4397-3648-4e8e-ae34-cec7f81e3d38 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:11.351597 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-11ea4397-3648-4e8e-ae34-cec7f81e3d38 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:11.364121 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-11ea4397-3648-4e8e-ae34-cec7f81e3d38 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:11.373740 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-11ea4397-3648-4e8e-ae34-cec7f81e3d38 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:11.374662 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-11ea4397-3648-4e8e-ae34-cec7f81e3d38 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:11.376212 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-11ea4397-3648-4e8e-ae34-cec7f81e3d38 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:11.607761 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-11ea4397-3648-4e8e-ae34-cec7f81e3d38 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:11.622356 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-11ea4397-3648-4e8e-ae34-cec7f81e3d38 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1559 microversion: 2.1 time: 0.282598 Sep 05 12:32:11.623395 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 227/449] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:11 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1559 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:11.649737 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-afccb417-379b-40ab-a0ac-35ae18ad9872 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:11.650655 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-afccb417-379b-40ab-a0ac-35ae18ad9872 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:11.661427 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-5717ddfc-dbb9-4d2a-94d7-1a413ff260d8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:11.663501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-5717ddfc-dbb9-4d2a-94d7-1a413ff260d8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:11.677277 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5717ddfc-dbb9-4d2a-94d7-1a413ff260d8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:11.680330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5717ddfc-dbb9-4d2a-94d7-1a413ff260d8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:11.681946 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5717ddfc-dbb9-4d2a-94d7-1a413ff260d8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:11.684723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5717ddfc-dbb9-4d2a-94d7-1a413ff260d8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:11.685455 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5717ddfc-dbb9-4d2a-94d7-1a413ff260d8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:11.686522 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5717ddfc-dbb9-4d2a-94d7-1a413ff260d8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:11.697170 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=100 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:11.726849 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-afccb417-379b-40ab-a0ac-35ae18ad9872 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:11.739755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-afccb417-379b-40ab-a0ac-35ae18ad9872 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1214 microversion: 2.1 time: 0.095460 Sep 05 12:32:11.741779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 223/450] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:11 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:11.827988 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-5717ddfc-dbb9-4d2a-94d7-1a413ff260d8 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.172091 Sep 05 12:32:11.827988 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 228/451] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Sep 5 12:32:11 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63/os-interface => generated 285 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:32:11.828242 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-35074e88-68c0-40e7-abdd-4ad161edb5ba req-5a776f53-c086-4678-8f84-7df7aeedc1ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee288301-eeb1-4e09-8a2c-d9bc6c00d914", "name": "network-vif-plugged", "status": "completed", "tag": "ebc2ee9e-37fa-4dbd-bf0a-e1f2b070c9fc"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:11.842772 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-35074e88-68c0-40e7-abdd-4ad161edb5ba req-5a776f53-c086-4678-8f84-7df7aeedc1ce service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:11.842772 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-35074e88-68c0-40e7-abdd-4ad161edb5ba req-5a776f53-c086-4678-8f84-7df7aeedc1ce service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:11.842772 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-35074e88-68c0-40e7-abdd-4ad161edb5ba req-5a776f53-c086-4678-8f84-7df7aeedc1ce service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:11.856414 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-35074e88-68c0-40e7-abdd-4ad161edb5ba req-5a776f53-c086-4678-8f84-7df7aeedc1ce service nova] Creating event network-vif-plugged:ebc2ee9e-37fa-4dbd-bf0a-e1f2b070c9fc for instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 on hv-cinder-80135 Sep 05 12:32:11.862554 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-35074e88-68c0-40e7-abdd-4ad161edb5ba req-5a776f53-c086-4678-8f84-7df7aeedc1ce service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042884 Sep 05 12:32:11.864107 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 224/452] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:32:11.935510 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-8e8fcda3-844d-49d6-ace0-fcc4c0ff6b2a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:11.936653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-8e8fcda3-844d-49d6-ace0-fcc4c0ff6b2a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:11.947441 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8e8fcda3-844d-49d6-ace0-fcc4c0ff6b2a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:11.950300 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8e8fcda3-844d-49d6-ace0-fcc4c0ff6b2a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:11.951256 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8e8fcda3-844d-49d6-ace0-fcc4c0ff6b2a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:11.952507 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8e8fcda3-844d-49d6-ace0-fcc4c0ff6b2a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:11.953300 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8e8fcda3-844d-49d6-ace0-fcc4c0ff6b2a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:11.954196 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8e8fcda3-844d-49d6-ace0-fcc4c0ff6b2a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:11.981399 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-b6a73c1e-1c32-443b-8989-69d159d9cf54 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:11.982113 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-b6a73c1e-1c32-443b-8989-69d159d9cf54 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:11.994829 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b6a73c1e-1c32-443b-8989-69d159d9cf54 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:11.995331 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b6a73c1e-1c32-443b-8989-69d159d9cf54 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:11.995820 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b6a73c1e-1c32-443b-8989-69d159d9cf54 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:11.996556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b6a73c1e-1c32-443b-8989-69d159d9cf54 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:11.997027 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b6a73c1e-1c32-443b-8989-69d159d9cf54 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:11.997455 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b6a73c1e-1c32-443b-8989-69d159d9cf54 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:12.392437 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-b6a73c1e-1c32-443b-8989-69d159d9cf54 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:12.402024 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-b6a73c1e-1c32-443b-8989-69d159d9cf54 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1370 microversion: 2.1 time: 0.425338 Sep 05 12:32:12.402747 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 225/453] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:11 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1370 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:32:12.423656 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-68ba6f4c-6fb8-46da-ade1-e0ece89a74d7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:12.424517 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-68ba6f4c-6fb8-46da-ade1-e0ece89a74d7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:12.431884 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-68ba6f4c-6fb8-46da-ade1-e0ece89a74d7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:12.433487 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-68ba6f4c-6fb8-46da-ade1-e0ece89a74d7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:12.434873 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-68ba6f4c-6fb8-46da-ade1-e0ece89a74d7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:12.436068 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-68ba6f4c-6fb8-46da-ade1-e0ece89a74d7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:12.436760 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-68ba6f4c-6fb8-46da-ade1-e0ece89a74d7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:12.437593 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-68ba6f4c-6fb8-46da-ade1-e0ece89a74d7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:12.523742 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-8e8fcda3-844d-49d6-ace0-fcc4c0ff6b2a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:12.533481 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-8e8fcda3-844d-49d6-ace0-fcc4c0ff6b2a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:12.542777 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-8e8fcda3-844d-49d6-ace0-fcc4c0ff6b2a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:12.544500 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-8e8fcda3-844d-49d6-ace0-fcc4c0ff6b2a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1720 microversion: 2.20 time: 0.613575 Sep 05 12:32:12.546130 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 229/454] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:11 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1720 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:12.722687 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-68ba6f4c-6fb8-46da-ade1-e0ece89a74d7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:12.732223 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-68ba6f4c-6fb8-46da-ade1-e0ece89a74d7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1265 microversion: 2.1 time: 0.314589 Sep 05 12:32:12.733132 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 226/455] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:12 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1265 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:12.769914 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-235abc2a-d689-4679-b964-0ec3883c27d7 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:12.771209 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-235abc2a-d689-4679-b964-0ec3883c27d7 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:12.792756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-235abc2a-d689-4679-b964-0ec3883c27d7 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:12.793259 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-235abc2a-d689-4679-b964-0ec3883c27d7 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:12.795175 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-235abc2a-d689-4679-b964-0ec3883c27d7 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:12.795175 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-235abc2a-d689-4679-b964-0ec3883c27d7 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:12.795175 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-235abc2a-d689-4679-b964-0ec3883c27d7 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:12.795468 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-235abc2a-d689-4679-b964-0ec3883c27d7 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:13.019775 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-235abc2a-d689-4679-b964-0ec3883c27d7 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:13.037955 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-235abc2a-d689-4679-b964-0ec3883c27d7 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1218 microversion: 2.1 time: 0.271964 Sep 05 12:32:13.044306 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 230/456] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:12 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1218 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:13.429806 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c23be1c2-ce34-4ce7-a0f4-7fd45a1519e5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:13.430430 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-c23be1c2-ce34-4ce7-a0f4-7fd45a1519e5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:13.437708 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c23be1c2-ce34-4ce7-a0f4-7fd45a1519e5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:13.442911 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c23be1c2-ce34-4ce7-a0f4-7fd45a1519e5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:13.444623 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c23be1c2-ce34-4ce7-a0f4-7fd45a1519e5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:13.446244 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c23be1c2-ce34-4ce7-a0f4-7fd45a1519e5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:13.446742 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c23be1c2-ce34-4ce7-a0f4-7fd45a1519e5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:13.447183 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c23be1c2-ce34-4ce7-a0f4-7fd45a1519e5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:13.575715 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-821b11ee-b91b-400b-9496-31084ada7130 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:13.576369 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-821b11ee-b91b-400b-9496-31084ada7130 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:13.589854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-821b11ee-b91b-400b-9496-31084ada7130 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:13.590350 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-821b11ee-b91b-400b-9496-31084ada7130 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:13.590792 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-821b11ee-b91b-400b-9496-31084ada7130 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:13.591514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-821b11ee-b91b-400b-9496-31084ada7130 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:13.592014 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-821b11ee-b91b-400b-9496-31084ada7130 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:13.594627 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-821b11ee-b91b-400b-9496-31084ada7130 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:13.689354 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c23be1c2-ce34-4ce7-a0f4-7fd45a1519e5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:13.700321 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-c23be1c2-ce34-4ce7-a0f4-7fd45a1519e5 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1565 microversion: 2.1 time: 0.275090 Sep 05 12:32:13.721093 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 227/457] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:13 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1565 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:13.728239 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-5e2c70f5-740d-4616-8fa6-21ffb19db009 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:13.729610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-5e2c70f5-740d-4616-8fa6-21ffb19db009 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:13.741245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5e2c70f5-740d-4616-8fa6-21ffb19db009 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:13.741810 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5e2c70f5-740d-4616-8fa6-21ffb19db009 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:13.743366 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5e2c70f5-740d-4616-8fa6-21ffb19db009 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:13.744756 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5e2c70f5-740d-4616-8fa6-21ffb19db009 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:13.745245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5e2c70f5-740d-4616-8fa6-21ffb19db009 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:13.745685 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5e2c70f5-740d-4616-8fa6-21ffb19db009 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:13.891223 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-5e2c70f5-740d-4616-8fa6-21ffb19db009 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.148093 Sep 05 12:32:13.896181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 228/458] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Sep 5 12:32:13 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-interface => generated 285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:32:13.900757 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-821b11ee-b91b-400b-9496-31084ada7130 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:13.907860 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-02dbea42-f92f-4368-98b1-2bfeea14ec55 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:13.908909 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-02dbea42-f92f-4368-98b1-2bfeea14ec55 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:13.915126 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-821b11ee-b91b-400b-9496-31084ada7130 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:13.916720 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-821b11ee-b91b-400b-9496-31084ada7130 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:13.918255 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-821b11ee-b91b-400b-9496-31084ada7130 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1720 microversion: 2.20 time: 0.347365 Sep 05 12:32:13.919360 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 231/459] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:13 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1720 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:13.924584 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-2f9bc652-3f0e-4b2d-b6ad-52bf566b8eb2 req-9376b876-a227-462f-8f7b-2c4dde8a77a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0105c66-6939-4b6d-b774-c1821012c1f0", "name": "network-vif-unplugged", "status": "completed", "tag": "09dffb1b-f334-42d1-bd74-8b59ed4648c3"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:13.934936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-2f9bc652-3f0e-4b2d-b6ad-52bf566b8eb2 req-9376b876-a227-462f-8f7b-2c4dde8a77a7 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:13.935903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-2f9bc652-3f0e-4b2d-b6ad-52bf566b8eb2 req-9376b876-a227-462f-8f7b-2c4dde8a77a7 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:13.947304 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-2f9bc652-3f0e-4b2d-b6ad-52bf566b8eb2 req-9376b876-a227-462f-8f7b-2c4dde8a77a7 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:13.947491 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-02dbea42-f92f-4368-98b1-2bfeea14ec55 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:13.947491 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-02dbea42-f92f-4368-98b1-2bfeea14ec55 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:13.947491 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-02dbea42-f92f-4368-98b1-2bfeea14ec55 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:13.947491 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-02dbea42-f92f-4368-98b1-2bfeea14ec55 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:13.947959 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-02dbea42-f92f-4368-98b1-2bfeea14ec55 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:13.947959 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-02dbea42-f92f-4368-98b1-2bfeea14ec55 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:13.950172 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-2f9bc652-3f0e-4b2d-b6ad-52bf566b8eb2 req-9376b876-a227-462f-8f7b-2c4dde8a77a7 service nova] Creating event network-vif-unplugged:09dffb1b-f334-42d1-bd74-8b59ed4648c3 for instance a0105c66-6939-4b6d-b774-c1821012c1f0 on hv-cinder-80135 Sep 05 12:32:13.958146 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-2f9bc652-3f0e-4b2d-b6ad-52bf566b8eb2 req-9376b876-a227-462f-8f7b-2c4dde8a77a7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037213 Sep 05 12:32:13.959955 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 232/460] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:32:14.028300 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-ebc35e99-82ce-45d4-a0c7-e346e54ae95d req-9154c608-c307-49b9-a0d6-f7db8daf2996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fac517b0-9cbe-4a6a-8922-21166ec0de63", "tag": "d28f89a7-e984-4c77-9cae-fe03a7c5c344"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:14.052212 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-ebc35e99-82ce-45d4-a0c7-e346e54ae95d req-9154c608-c307-49b9-a0d6-f7db8daf2996 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:14.055807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-ebc35e99-82ce-45d4-a0c7-e346e54ae95d req-9154c608-c307-49b9-a0d6-f7db8daf2996 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:14.056623 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-ebc35e99-82ce-45d4-a0c7-e346e54ae95d req-9154c608-c307-49b9-a0d6-f7db8daf2996 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:14.087935 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-ebc35e99-82ce-45d4-a0c7-e346e54ae95d req-9154c608-c307-49b9-a0d6-f7db8daf2996 service nova] Creating event network-changed:d28f89a7-e984-4c77-9cae-fe03a7c5c344 for instance fac517b0-9cbe-4a6a-8922-21166ec0de63 on hv-cinder-80135 Sep 05 12:32:14.094039 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-ebc35e99-82ce-45d4-a0c7-e346e54ae95d req-9154c608-c307-49b9-a0d6-f7db8daf2996 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070027 Sep 05 12:32:14.095306 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 233/461] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:32:14.102045 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-5aa33a7f-9f24-417e-942f-1e38bdf5e78f tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:14.103220 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-5aa33a7f-9f24-417e-942f-1e38bdf5e78f tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:14.110315 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5aa33a7f-9f24-417e-942f-1e38bdf5e78f tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:14.111088 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5aa33a7f-9f24-417e-942f-1e38bdf5e78f tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:14.111780 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5aa33a7f-9f24-417e-942f-1e38bdf5e78f tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:14.112990 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5aa33a7f-9f24-417e-942f-1e38bdf5e78f tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:14.113663 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5aa33a7f-9f24-417e-942f-1e38bdf5e78f tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:14.114304 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5aa33a7f-9f24-417e-942f-1e38bdf5e78f tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:14.224649 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-5aa33a7f-9f24-417e-942f-1e38bdf5e78f tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:14.234659 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-5aa33a7f-9f24-417e-942f-1e38bdf5e78f tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1210 microversion: 2.1 time: 0.137656 Sep 05 12:32:14.235246 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 234/462] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:14 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1210 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:14.397167 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-02dbea42-f92f-4368-98b1-2bfeea14ec55 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:14.409764 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-02dbea42-f92f-4368-98b1-2bfeea14ec55 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1265 microversion: 2.1 time: 0.511457 Sep 05 12:32:14.420871 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 229/463] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:13 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1265 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:14.945013 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-74d14c66-92f7-446a-bbb7-20e58bb013af tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:14.946257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-74d14c66-92f7-446a-bbb7-20e58bb013af tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:14.966525 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-74d14c66-92f7-446a-bbb7-20e58bb013af tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:14.968241 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-74d14c66-92f7-446a-bbb7-20e58bb013af tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:14.974439 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-74d14c66-92f7-446a-bbb7-20e58bb013af tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:14.979249 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-74d14c66-92f7-446a-bbb7-20e58bb013af tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:14.981489 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-74d14c66-92f7-446a-bbb7-20e58bb013af tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:14.982141 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-74d14c66-92f7-446a-bbb7-20e58bb013af tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:15.259049 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-cecc44d7-9b71-4116-81fe-1bdb9370e527 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:15.259763 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-cecc44d7-9b71-4116-81fe-1bdb9370e527 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:15.278854 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cecc44d7-9b71-4116-81fe-1bdb9370e527 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:15.281115 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cecc44d7-9b71-4116-81fe-1bdb9370e527 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:15.284179 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cecc44d7-9b71-4116-81fe-1bdb9370e527 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:15.285235 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cecc44d7-9b71-4116-81fe-1bdb9370e527 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:15.288934 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cecc44d7-9b71-4116-81fe-1bdb9370e527 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:15.293248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cecc44d7-9b71-4116-81fe-1bdb9370e527 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:15.313272 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-74d14c66-92f7-446a-bbb7-20e58bb013af tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:15.323209 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-74d14c66-92f7-446a-bbb7-20e58bb013af tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:15.324942 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-74d14c66-92f7-446a-bbb7-20e58bb013af tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:15.326238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-74d14c66-92f7-446a-bbb7-20e58bb013af tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1720 microversion: 2.20 time: 0.385527 Sep 05 12:32:15.327232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 235/464] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:14 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1720 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:15.437597 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-fc3f455a-f3eb-4191-8475-a47256ffd6cc tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:15.448409 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-fc3f455a-f3eb-4191-8475-a47256ffd6cc tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:15.455460 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-cecc44d7-9b71-4116-81fe-1bdb9370e527 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:15.464540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-cecc44d7-9b71-4116-81fe-1bdb9370e527 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1266 microversion: 2.1 time: 0.210010 Sep 05 12:32:15.482620 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fc3f455a-f3eb-4191-8475-a47256ffd6cc tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:15.482620 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fc3f455a-f3eb-4191-8475-a47256ffd6cc tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:15.483309 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 230/465] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:15 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:32:15.483417 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fc3f455a-f3eb-4191-8475-a47256ffd6cc tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:15.483417 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fc3f455a-f3eb-4191-8475-a47256ffd6cc tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:15.483417 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fc3f455a-f3eb-4191-8475-a47256ffd6cc tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:15.483417 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fc3f455a-f3eb-4191-8475-a47256ffd6cc tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:15.729521 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-fc3f455a-f3eb-4191-8475-a47256ffd6cc tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:15.766948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-fc3f455a-f3eb-4191-8475-a47256ffd6cc tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1265 microversion: 2.1 time: 0.331395 Sep 05 12:32:15.785864 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 236/466] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:15 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1265 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:16.356396 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-9e958d44-c48e-4e06-bb86-a7346d42730a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:16.357652 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-9e958d44-c48e-4e06-bb86-a7346d42730a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:16.369526 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9e958d44-c48e-4e06-bb86-a7346d42730a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:16.370692 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9e958d44-c48e-4e06-bb86-a7346d42730a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:16.373229 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9e958d44-c48e-4e06-bb86-a7346d42730a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:16.374383 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9e958d44-c48e-4e06-bb86-a7346d42730a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:16.376661 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9e958d44-c48e-4e06-bb86-a7346d42730a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:16.379245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9e958d44-c48e-4e06-bb86-a7346d42730a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:16.384238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-ff1e9e82-3589-4253-9bb8-5094b0336b1d req-b9d51cba-48da-40ed-8b7d-dfe39d5a6a5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c86e0b82-f349-40c6-986b-359cb36a9862", "tag": "66947e6f-24aa-4efc-9fc1-09b650127cb3"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:16.401545 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-ff1e9e82-3589-4253-9bb8-5094b0336b1d req-b9d51cba-48da-40ed-8b7d-dfe39d5a6a5d service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:16.402049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-ff1e9e82-3589-4253-9bb8-5094b0336b1d req-b9d51cba-48da-40ed-8b7d-dfe39d5a6a5d service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:16.402468 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-ff1e9e82-3589-4253-9bb8-5094b0336b1d req-b9d51cba-48da-40ed-8b7d-dfe39d5a6a5d service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:16.432072 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-ff1e9e82-3589-4253-9bb8-5094b0336b1d req-b9d51cba-48da-40ed-8b7d-dfe39d5a6a5d service nova] Creating event network-changed:66947e6f-24aa-4efc-9fc1-09b650127cb3 for instance c86e0b82-f349-40c6-986b-359cb36a9862 on hv-cinder-80135 Sep 05 12:32:16.438603 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-ff1e9e82-3589-4253-9bb8-5094b0336b1d req-b9d51cba-48da-40ed-8b7d-dfe39d5a6a5d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058710 Sep 05 12:32:16.439522 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 237/467] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:32:16.493444 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-09bded7d-90eb-44c2-8578-14d847517ec9 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:16.497542 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-09bded7d-90eb-44c2-8578-14d847517ec9 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:16.504042 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-09bded7d-90eb-44c2-8578-14d847517ec9 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:16.505208 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-09bded7d-90eb-44c2-8578-14d847517ec9 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:16.505930 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-09bded7d-90eb-44c2-8578-14d847517ec9 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:16.507069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-09bded7d-90eb-44c2-8578-14d847517ec9 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:16.508366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-09bded7d-90eb-44c2-8578-14d847517ec9 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:16.509450 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-09bded7d-90eb-44c2-8578-14d847517ec9 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:16.641900 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-09bded7d-90eb-44c2-8578-14d847517ec9 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:16.651829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-09bded7d-90eb-44c2-8578-14d847517ec9 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1266 microversion: 2.1 time: 0.164471 Sep 05 12:32:16.669008 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 238/468] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:16 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:32:16.669355 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-9e958d44-c48e-4e06-bb86-a7346d42730a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:16.680482 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-9e958d44-c48e-4e06-bb86-a7346d42730a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:16.681932 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-9e958d44-c48e-4e06-bb86-a7346d42730a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:16.683133 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-9e958d44-c48e-4e06-bb86-a7346d42730a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1723 microversion: 2.20 time: 0.331192 Sep 05 12:32:16.692563 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 231/469] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:16 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1723 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:16.710318 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-026d6509-9268-4a60-b2d1-89245fa2905b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33032ce3-0e9f-4da4-8585-1fbedb4e7676"}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:16.713021 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-026d6509-9268-4a60-b2d1-89245fa2905b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:16.725754 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-026d6509-9268-4a60-b2d1-89245fa2905b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:16.733340 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-026d6509-9268-4a60-b2d1-89245fa2905b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:16.741116 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-026d6509-9268-4a60-b2d1-89245fa2905b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:16.741950 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-026d6509-9268-4a60-b2d1-89245fa2905b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:16.742434 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-026d6509-9268-4a60-b2d1-89245fa2905b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:16.742876 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-026d6509-9268-4a60-b2d1-89245fa2905b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:16.790989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f31a04fc-29c0-4470-8034-134f501af1a6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:16.792011 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f31a04fc-29c0-4470-8034-134f501af1a6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:16.798564 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f31a04fc-29c0-4470-8034-134f501af1a6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:16.799347 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f31a04fc-29c0-4470-8034-134f501af1a6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:16.800009 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f31a04fc-29c0-4470-8034-134f501af1a6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:16.800885 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f31a04fc-29c0-4470-8034-134f501af1a6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:16.801359 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f31a04fc-29c0-4470-8034-134f501af1a6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:16.802037 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f31a04fc-29c0-4470-8034-134f501af1a6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:17.034434 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f31a04fc-29c0-4470-8034-134f501af1a6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:17.053594 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f31a04fc-29c0-4470-8034-134f501af1a6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1265 microversion: 2.1 time: 0.267204 Sep 05 12:32:17.069817 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 232/470] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:16 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1265 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:17.678707 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ff3e8fb3-5f29-462a-8f68-66cfcda41734 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:17.681618 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ff3e8fb3-5f29-462a-8f68-66cfcda41734 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:17.692716 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ff3e8fb3-5f29-462a-8f68-66cfcda41734 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:17.696652 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ff3e8fb3-5f29-462a-8f68-66cfcda41734 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:17.697426 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ff3e8fb3-5f29-462a-8f68-66cfcda41734 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:17.700715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ff3e8fb3-5f29-462a-8f68-66cfcda41734 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:17.704055 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ff3e8fb3-5f29-462a-8f68-66cfcda41734 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:17.704869 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ff3e8fb3-5f29-462a-8f68-66cfcda41734 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:17.927426 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ff3e8fb3-5f29-462a-8f68-66cfcda41734 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:17.937627 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ff3e8fb3-5f29-462a-8f68-66cfcda41734 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1266 microversion: 2.1 time: 0.262627 Sep 05 12:32:17.938239 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 233/471] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:17 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:32:18.079880 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-969e298d-3544-495e-8ff0-14ad712e4734 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:18.080526 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-969e298d-3544-495e-8ff0-14ad712e4734 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:18.086963 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-969e298d-3544-495e-8ff0-14ad712e4734 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:18.087480 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-969e298d-3544-495e-8ff0-14ad712e4734 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:18.087961 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-969e298d-3544-495e-8ff0-14ad712e4734 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:18.088675 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-969e298d-3544-495e-8ff0-14ad712e4734 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:18.089138 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-969e298d-3544-495e-8ff0-14ad712e4734 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:18.089573 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-969e298d-3544-495e-8ff0-14ad712e4734 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:18.302329 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-969e298d-3544-495e-8ff0-14ad712e4734 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:18.310960 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-969e298d-3544-495e-8ff0-14ad712e4734 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1452 microversion: 2.1 time: 0.234942 Sep 05 12:32:18.328231 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 234/472] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:18 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1452 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:32:18.335247 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c7863352-bd77-4152-8d7a-bb55e617374d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:18.335925 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-c7863352-bd77-4152-8d7a-bb55e617374d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:18.345043 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c7863352-bd77-4152-8d7a-bb55e617374d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:18.345502 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c7863352-bd77-4152-8d7a-bb55e617374d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:18.345945 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c7863352-bd77-4152-8d7a-bb55e617374d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:18.346657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c7863352-bd77-4152-8d7a-bb55e617374d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:18.347288 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c7863352-bd77-4152-8d7a-bb55e617374d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:18.348026 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c7863352-bd77-4152-8d7a-bb55e617374d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:18.353455 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=100 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:18.370866 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-026d6509-9268-4a60-b2d1-89245fa2905b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "POST /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.663947 Sep 05 12:32:18.377335 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 239/473] 10.222.0.62 () {62 vars in 1364 bytes} [Mon Sep 5 12:32:16 2022] POST /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/os-volume_attachments => generated 188 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:32:18.550572 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c7863352-bd77-4152-8d7a-bb55e617374d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:18.551520 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-102ea845-fbc1-44df-becd-d84991b26291 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:18.552156 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-102ea845-fbc1-44df-becd-d84991b26291 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:18.560397 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-102ea845-fbc1-44df-becd-d84991b26291 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:18.566385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-102ea845-fbc1-44df-becd-d84991b26291 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:18.568920 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-102ea845-fbc1-44df-becd-d84991b26291 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:18.569077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-c7863352-bd77-4152-8d7a-bb55e617374d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1452 microversion: 2.1 time: 0.236305 Sep 05 12:32:18.569980 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-102ea845-fbc1-44df-becd-d84991b26291 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:18.572090 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 235/474] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:18 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1452 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:18.588403 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-102ea845-fbc1-44df-becd-d84991b26291 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:18.588759 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-102ea845-fbc1-44df-becd-d84991b26291 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:18.687002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-102ea845-fbc1-44df-becd-d84991b26291 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121210) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 05 12:32:18.970289 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-176cbbe6-074e-48cd-9abe-80e6f7d35051 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:18.972994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-176cbbe6-074e-48cd-9abe-80e6f7d35051 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:19.006536 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-176cbbe6-074e-48cd-9abe-80e6f7d35051 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:19.010304 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-176cbbe6-074e-48cd-9abe-80e6f7d35051 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:19.025158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-176cbbe6-074e-48cd-9abe-80e6f7d35051 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:19.029997 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-176cbbe6-074e-48cd-9abe-80e6f7d35051 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:19.030592 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-176cbbe6-074e-48cd-9abe-80e6f7d35051 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:19.033042 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-176cbbe6-074e-48cd-9abe-80e6f7d35051 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:19.142816 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-176cbbe6-074e-48cd-9abe-80e6f7d35051 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:19.142816 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-176cbbe6-074e-48cd-9abe-80e6f7d35051 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1274 microversion: 2.1 time: 0.170492 Sep 05 12:32:19.142816 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 236/475] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:18 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1274 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:19.302301 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-102ea845-fbc1-44df-becd-d84991b26291 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "POST /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/action" status: 202 len: 0 microversion: 2.20 time: 0.753684 Sep 05 12:32:19.304566 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 240/476] 10.222.0.62 () {62 vars in 1319 bytes} [Mon Sep 5 12:32:18 2022] POST /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/action => generated 0 bytes in 758 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 05 12:32:19.314062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c65e1076-edb0-400a-965d-6d6270b74999 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:19.315242 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-c65e1076-edb0-400a-965d-6d6270b74999 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:19.332028 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c65e1076-edb0-400a-965d-6d6270b74999 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:19.332527 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c65e1076-edb0-400a-965d-6d6270b74999 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:19.332964 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c65e1076-edb0-400a-965d-6d6270b74999 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:19.334483 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c65e1076-edb0-400a-965d-6d6270b74999 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:19.334483 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c65e1076-edb0-400a-965d-6d6270b74999 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:19.334701 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c65e1076-edb0-400a-965d-6d6270b74999 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:19.649329 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c65e1076-edb0-400a-965d-6d6270b74999 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:19.656795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c65e1076-edb0-400a-965d-6d6270b74999 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:19.658592 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c65e1076-edb0-400a-965d-6d6270b74999 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:19.660547 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-c65e1076-edb0-400a-965d-6d6270b74999 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1749 microversion: 2.20 time: 0.351726 Sep 05 12:32:19.672531 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 237/477] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:19 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1749 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:20.158176 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a8a09212-06bd-4e5d-b7d1-722f01e708f4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:20.160073 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a8a09212-06bd-4e5d-b7d1-722f01e708f4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:20.169161 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a8a09212-06bd-4e5d-b7d1-722f01e708f4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:20.169161 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a8a09212-06bd-4e5d-b7d1-722f01e708f4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:20.169161 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a8a09212-06bd-4e5d-b7d1-722f01e708f4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:20.169161 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a8a09212-06bd-4e5d-b7d1-722f01e708f4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:20.169637 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a8a09212-06bd-4e5d-b7d1-722f01e708f4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:20.169637 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a8a09212-06bd-4e5d-b7d1-722f01e708f4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:20.298513 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a8a09212-06bd-4e5d-b7d1-722f01e708f4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:20.311443 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a8a09212-06bd-4e5d-b7d1-722f01e708f4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1272 microversion: 2.1 time: 0.157026 Sep 05 12:32:20.323562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 241/478] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:20 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:20.688898 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a45de10a-58de-4fa2-8209-adc73df5cf87 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:20.689523 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a45de10a-58de-4fa2-8209-adc73df5cf87 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:20.692950 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=2 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:20.704142 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a45de10a-58de-4fa2-8209-adc73df5cf87 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:20.704836 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a45de10a-58de-4fa2-8209-adc73df5cf87 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:20.706047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a45de10a-58de-4fa2-8209-adc73df5cf87 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:20.706279 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a45de10a-58de-4fa2-8209-adc73df5cf87 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:20.706747 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a45de10a-58de-4fa2-8209-adc73df5cf87 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:20.707178 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a45de10a-58de-4fa2-8209-adc73df5cf87 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:20.972240 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a45de10a-58de-4fa2-8209-adc73df5cf87 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:20.985989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a45de10a-58de-4fa2-8209-adc73df5cf87 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:20.987792 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a45de10a-58de-4fa2-8209-adc73df5cf87 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:20.989234 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a45de10a-58de-4fa2-8209-adc73df5cf87 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1749 microversion: 2.20 time: 0.304697 Sep 05 12:32:20.990818 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 238/479] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:20 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1749 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:21.339855 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e85d6237-955e-465a-997f-15b452907527 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:21.340712 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-e85d6237-955e-465a-997f-15b452907527 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:21.347285 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=2 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:21.351419 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e85d6237-955e-465a-997f-15b452907527 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:21.352950 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e85d6237-955e-465a-997f-15b452907527 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:21.352950 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e85d6237-955e-465a-997f-15b452907527 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:21.354057 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e85d6237-955e-465a-997f-15b452907527 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:21.354720 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e85d6237-955e-465a-997f-15b452907527 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:21.356236 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e85d6237-955e-465a-997f-15b452907527 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:21.601139 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-e85d6237-955e-465a-997f-15b452907527 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:21.614071 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-e85d6237-955e-465a-997f-15b452907527 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1314 microversion: 2.1 time: 0.277868 Sep 05 12:32:21.632597 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 242/480] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:21 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:21.790848 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-69855747-d6ba-4283-9f7d-227e3509d7ae req-e2e198ac-e94b-40dd-b61b-712d95673b64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee288301-eeb1-4e09-8a2c-d9bc6c00d914", "tag": "ebc2ee9e-37fa-4dbd-bf0a-e1f2b070c9fc"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:21.800752 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=8 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:21.802826 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-69855747-d6ba-4283-9f7d-227e3509d7ae req-e2e198ac-e94b-40dd-b61b-712d95673b64 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:21.803314 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-69855747-d6ba-4283-9f7d-227e3509d7ae req-e2e198ac-e94b-40dd-b61b-712d95673b64 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:21.803781 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-69855747-d6ba-4283-9f7d-227e3509d7ae req-e2e198ac-e94b-40dd-b61b-712d95673b64 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:21.818565 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-69855747-d6ba-4283-9f7d-227e3509d7ae req-e2e198ac-e94b-40dd-b61b-712d95673b64 service nova] Creating event network-changed:ebc2ee9e-37fa-4dbd-bf0a-e1f2b070c9fc for instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 on hv-cinder-80135 Sep 05 12:32:21.825368 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-69855747-d6ba-4283-9f7d-227e3509d7ae req-e2e198ac-e94b-40dd-b61b-712d95673b64 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038640 Sep 05 12:32:21.826299 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 239/481] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:32:22.017228 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-50b1eee7-3108-46da-8048-73ffd08fcc36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:22.018235 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-50b1eee7-3108-46da-8048-73ffd08fcc36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:22.025119 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-50b1eee7-3108-46da-8048-73ffd08fcc36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:22.025615 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-50b1eee7-3108-46da-8048-73ffd08fcc36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:22.026050 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-50b1eee7-3108-46da-8048-73ffd08fcc36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:22.026946 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-50b1eee7-3108-46da-8048-73ffd08fcc36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:22.027418 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-50b1eee7-3108-46da-8048-73ffd08fcc36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:22.027871 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-50b1eee7-3108-46da-8048-73ffd08fcc36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:22.058096 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:22.212792 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-50b1eee7-3108-46da-8048-73ffd08fcc36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:22.227376 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-50b1eee7-3108-46da-8048-73ffd08fcc36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:22.229864 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-50b1eee7-3108-46da-8048-73ffd08fcc36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:22.231939 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-50b1eee7-3108-46da-8048-73ffd08fcc36 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1751 microversion: 2.20 time: 0.219209 Sep 05 12:32:22.247673 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 243/482] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:22 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1751 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:22.301451 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-928378ef-4b50-4fc3-b896-5b5a95429229 req-b5affe89-fe2b-4c69-8828-e471c9d2836b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6783eb5-1683-4222-9f06-774719632959", "tag": "d8fd2312-4b92-4447-905d-b0a66194e316"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:22.316645 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-928378ef-4b50-4fc3-b896-5b5a95429229 req-b5affe89-fe2b-4c69-8828-e471c9d2836b service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:22.317154 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-928378ef-4b50-4fc3-b896-5b5a95429229 req-b5affe89-fe2b-4c69-8828-e471c9d2836b service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:22.317589 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-928378ef-4b50-4fc3-b896-5b5a95429229 req-b5affe89-fe2b-4c69-8828-e471c9d2836b service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:22.335018 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-928378ef-4b50-4fc3-b896-5b5a95429229 req-b5affe89-fe2b-4c69-8828-e471c9d2836b service nova] Creating event network-changed:d8fd2312-4b92-4447-905d-b0a66194e316 for instance b6783eb5-1683-4222-9f06-774719632959 on hv-cinder-80135 Sep 05 12:32:22.339951 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-928378ef-4b50-4fc3-b896-5b5a95429229 req-b5affe89-fe2b-4c69-8828-e471c9d2836b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044065 Sep 05 12:32:22.341132 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 240/483] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:32:22.638674 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-f256d46c-fa2f-4d60-be21-76091d2573e3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:22.639519 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-f256d46c-fa2f-4d60-be21-76091d2573e3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:22.646531 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f256d46c-fa2f-4d60-be21-76091d2573e3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:22.647028 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f256d46c-fa2f-4d60-be21-76091d2573e3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:22.647454 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f256d46c-fa2f-4d60-be21-76091d2573e3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:22.648209 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f256d46c-fa2f-4d60-be21-76091d2573e3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:22.648659 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f256d46c-fa2f-4d60-be21-76091d2573e3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:22.649126 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f256d46c-fa2f-4d60-be21-76091d2573e3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:22.812934 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f256d46c-fa2f-4d60-be21-76091d2573e3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:22.822429 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-f256d46c-fa2f-4d60-be21-76091d2573e3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1314 microversion: 2.1 time: 0.187561 Sep 05 12:32:22.823173 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 244/484] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:22 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:32:23.266800 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c196ba77-6f48-45fc-8a02-e1d38ea0ac07 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:23.267498 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-c196ba77-6f48-45fc-8a02-e1d38ea0ac07 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:23.275040 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c196ba77-6f48-45fc-8a02-e1d38ea0ac07 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:23.275524 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c196ba77-6f48-45fc-8a02-e1d38ea0ac07 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:23.276184 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c196ba77-6f48-45fc-8a02-e1d38ea0ac07 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:23.277072 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c196ba77-6f48-45fc-8a02-e1d38ea0ac07 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:23.277528 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c196ba77-6f48-45fc-8a02-e1d38ea0ac07 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:23.278607 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c196ba77-6f48-45fc-8a02-e1d38ea0ac07 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:23.418407 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c196ba77-6f48-45fc-8a02-e1d38ea0ac07 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:23.427267 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c196ba77-6f48-45fc-8a02-e1d38ea0ac07 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:23.428870 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c196ba77-6f48-45fc-8a02-e1d38ea0ac07 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:23.437768 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-c196ba77-6f48-45fc-8a02-e1d38ea0ac07 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1751 microversion: 2.20 time: 0.169163 Sep 05 12:32:23.437768 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 241/485] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:23 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:23.845899 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-f4d221ea-7be5-4cc5-a0e8-2d1eb7ef31ef tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:23.846502 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-f4d221ea-7be5-4cc5-a0e8-2d1eb7ef31ef tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:23.856270 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f4d221ea-7be5-4cc5-a0e8-2d1eb7ef31ef tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:23.857485 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f4d221ea-7be5-4cc5-a0e8-2d1eb7ef31ef tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:23.858459 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f4d221ea-7be5-4cc5-a0e8-2d1eb7ef31ef tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:23.859037 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f4d221ea-7be5-4cc5-a0e8-2d1eb7ef31ef tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:23.859494 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f4d221ea-7be5-4cc5-a0e8-2d1eb7ef31ef tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:23.860750 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f4d221ea-7be5-4cc5-a0e8-2d1eb7ef31ef tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:24.015393 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f4d221ea-7be5-4cc5-a0e8-2d1eb7ef31ef tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:24.024138 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-f4d221ea-7be5-4cc5-a0e8-2d1eb7ef31ef tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1314 microversion: 2.1 time: 0.182087 Sep 05 12:32:24.024729 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 245/486] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:23 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:24.456571 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-97dff269-9049-4bd3-a7d7-ff9a9c349bfd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:24.457173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-97dff269-9049-4bd3-a7d7-ff9a9c349bfd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:24.463962 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-97dff269-9049-4bd3-a7d7-ff9a9c349bfd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:24.464453 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-97dff269-9049-4bd3-a7d7-ff9a9c349bfd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:24.464884 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-97dff269-9049-4bd3-a7d7-ff9a9c349bfd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:24.465629 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-97dff269-9049-4bd3-a7d7-ff9a9c349bfd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:24.466078 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-97dff269-9049-4bd3-a7d7-ff9a9c349bfd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:24.466496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-97dff269-9049-4bd3-a7d7-ff9a9c349bfd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:24.633930 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-97dff269-9049-4bd3-a7d7-ff9a9c349bfd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:24.647116 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-97dff269-9049-4bd3-a7d7-ff9a9c349bfd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:24.648684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-97dff269-9049-4bd3-a7d7-ff9a9c349bfd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:24.650101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-97dff269-9049-4bd3-a7d7-ff9a9c349bfd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1751 microversion: 2.20 time: 0.197747 Sep 05 12:32:24.650660 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 242/487] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:24 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1751 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:25.048419 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-efb4fddc-f186-4211-a9ac-5a8d06789ff4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:25.049033 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-efb4fddc-f186-4211-a9ac-5a8d06789ff4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:25.057309 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-efb4fddc-f186-4211-a9ac-5a8d06789ff4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:25.057794 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-efb4fddc-f186-4211-a9ac-5a8d06789ff4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:25.058223 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-efb4fddc-f186-4211-a9ac-5a8d06789ff4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:25.058914 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-efb4fddc-f186-4211-a9ac-5a8d06789ff4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:25.059363 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-efb4fddc-f186-4211-a9ac-5a8d06789ff4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:25.059942 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-efb4fddc-f186-4211-a9ac-5a8d06789ff4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:25.206408 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-efb4fddc-f186-4211-a9ac-5a8d06789ff4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:25.215280 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-efb4fddc-f186-4211-a9ac-5a8d06789ff4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1314 microversion: 2.1 time: 0.171077 Sep 05 12:32:25.227959 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 246/488] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:25 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:25.677189 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-5ee53a59-1e58-4ecb-aef9-9a7271480f8f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:25.678704 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-5ee53a59-1e58-4ecb-aef9-9a7271480f8f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:25.686236 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5ee53a59-1e58-4ecb-aef9-9a7271480f8f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:25.687279 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5ee53a59-1e58-4ecb-aef9-9a7271480f8f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:25.687279 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5ee53a59-1e58-4ecb-aef9-9a7271480f8f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:25.691620 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5ee53a59-1e58-4ecb-aef9-9a7271480f8f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:25.692329 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5ee53a59-1e58-4ecb-aef9-9a7271480f8f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:25.692771 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5ee53a59-1e58-4ecb-aef9-9a7271480f8f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:25.837933 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5ee53a59-1e58-4ecb-aef9-9a7271480f8f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:25.847045 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5ee53a59-1e58-4ecb-aef9-9a7271480f8f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:25.848525 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5ee53a59-1e58-4ecb-aef9-9a7271480f8f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:25.850239 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-5ee53a59-1e58-4ecb-aef9-9a7271480f8f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.176901 Sep 05 12:32:25.850793 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 243/489] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:25 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:26.239460 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-6a2ff915-9a1b-4761-9877-c0e07843f190 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:26.240091 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-6a2ff915-9a1b-4761-9877-c0e07843f190 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:26.247761 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6a2ff915-9a1b-4761-9877-c0e07843f190 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:26.248244 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6a2ff915-9a1b-4761-9877-c0e07843f190 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:26.248664 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6a2ff915-9a1b-4761-9877-c0e07843f190 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:26.249362 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6a2ff915-9a1b-4761-9877-c0e07843f190 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:26.249806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6a2ff915-9a1b-4761-9877-c0e07843f190 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:26.250328 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6a2ff915-9a1b-4761-9877-c0e07843f190 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:26.420142 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6a2ff915-9a1b-4761-9877-c0e07843f190 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:26.429477 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-6a2ff915-9a1b-4761-9877-c0e07843f190 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1314 microversion: 2.1 time: 0.194097 Sep 05 12:32:26.430071 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 247/490] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:26 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:26.878379 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-5074c717-7aec-4a09-93ff-b12f170b10ed tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:26.878952 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-5074c717-7aec-4a09-93ff-b12f170b10ed tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:26.885909 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5074c717-7aec-4a09-93ff-b12f170b10ed tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:26.886391 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5074c717-7aec-4a09-93ff-b12f170b10ed tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:26.886815 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5074c717-7aec-4a09-93ff-b12f170b10ed tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:26.887527 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5074c717-7aec-4a09-93ff-b12f170b10ed tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:26.887995 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5074c717-7aec-4a09-93ff-b12f170b10ed tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:26.888412 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5074c717-7aec-4a09-93ff-b12f170b10ed tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:27.042021 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5074c717-7aec-4a09-93ff-b12f170b10ed tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:27.055405 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5074c717-7aec-4a09-93ff-b12f170b10ed tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:27.057370 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5074c717-7aec-4a09-93ff-b12f170b10ed tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:27.058586 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-5074c717-7aec-4a09-93ff-b12f170b10ed tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.185630 Sep 05 12:32:27.059267 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 244/491] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:26 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:27.453897 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-def60ab7-3f6d-42dd-b669-0bb9b100e9f3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:27.454553 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-def60ab7-3f6d-42dd-b669-0bb9b100e9f3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:27.462066 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-def60ab7-3f6d-42dd-b669-0bb9b100e9f3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:27.462939 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-def60ab7-3f6d-42dd-b669-0bb9b100e9f3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:27.463950 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-def60ab7-3f6d-42dd-b669-0bb9b100e9f3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:27.464887 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-def60ab7-3f6d-42dd-b669-0bb9b100e9f3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:27.465559 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-def60ab7-3f6d-42dd-b669-0bb9b100e9f3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:27.466200 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-def60ab7-3f6d-42dd-b669-0bb9b100e9f3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:27.662626 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-def60ab7-3f6d-42dd-b669-0bb9b100e9f3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:27.673496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-def60ab7-3f6d-42dd-b669-0bb9b100e9f3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1314 microversion: 2.1 time: 0.223464 Sep 05 12:32:27.674262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 248/492] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:27 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:27.851812 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-95e5f2b2-2ba0-4e92-bd17-be600724736e req-4e016f2a-6605-43c2-99e8-89d8cb66cceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6783eb5-1683-4222-9f06-774719632959", "name": "network-vif-plugged", "status": "completed", "tag": "d8fd2312-4b92-4447-905d-b0a66194e316"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:27.867158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-95e5f2b2-2ba0-4e92-bd17-be600724736e req-4e016f2a-6605-43c2-99e8-89d8cb66cceb service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:27.867699 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-95e5f2b2-2ba0-4e92-bd17-be600724736e req-4e016f2a-6605-43c2-99e8-89d8cb66cceb service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:27.868137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-95e5f2b2-2ba0-4e92-bd17-be600724736e req-4e016f2a-6605-43c2-99e8-89d8cb66cceb service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:27.902246 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-95e5f2b2-2ba0-4e92-bd17-be600724736e req-4e016f2a-6605-43c2-99e8-89d8cb66cceb service nova] Creating event network-vif-plugged:d8fd2312-4b92-4447-905d-b0a66194e316 for instance b6783eb5-1683-4222-9f06-774719632959 on hv-cinder-80135 Sep 05 12:32:27.913462 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-95e5f2b2-2ba0-4e92-bd17-be600724736e req-4e016f2a-6605-43c2-99e8-89d8cb66cceb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064209 Sep 05 12:32:27.914071 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 245/493] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:32:28.087209 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1183d325-5b73-4a3d-a8f7-5388758b9c73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:28.088053 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1183d325-5b73-4a3d-a8f7-5388758b9c73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:28.095363 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1183d325-5b73-4a3d-a8f7-5388758b9c73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:28.096097 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1183d325-5b73-4a3d-a8f7-5388758b9c73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:28.096694 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1183d325-5b73-4a3d-a8f7-5388758b9c73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:28.097603 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1183d325-5b73-4a3d-a8f7-5388758b9c73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:28.098293 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1183d325-5b73-4a3d-a8f7-5388758b9c73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:28.098800 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1183d325-5b73-4a3d-a8f7-5388758b9c73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:28.287019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1183d325-5b73-4a3d-a8f7-5388758b9c73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:28.297031 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1183d325-5b73-4a3d-a8f7-5388758b9c73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:28.298484 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1183d325-5b73-4a3d-a8f7-5388758b9c73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:28.299676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1183d325-5b73-4a3d-a8f7-5388758b9c73 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.217791 Sep 05 12:32:28.300231 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 249/494] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:28 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:28.702539 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7d97793f-c509-4aac-9f4a-df78b0a75f99 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:28.704543 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-7d97793f-c509-4aac-9f4a-df78b0a75f99 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:28.711847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7d97793f-c509-4aac-9f4a-df78b0a75f99 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:28.712719 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7d97793f-c509-4aac-9f4a-df78b0a75f99 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:28.713381 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7d97793f-c509-4aac-9f4a-df78b0a75f99 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:28.715760 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7d97793f-c509-4aac-9f4a-df78b0a75f99 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:28.716901 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7d97793f-c509-4aac-9f4a-df78b0a75f99 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:28.717569 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7d97793f-c509-4aac-9f4a-df78b0a75f99 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:28.875426 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-7d97793f-c509-4aac-9f4a-df78b0a75f99 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:28.883621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-7d97793f-c509-4aac-9f4a-df78b0a75f99 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1314 microversion: 2.1 time: 0.187075 Sep 05 12:32:28.884209 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 246/495] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:28 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:29.327439 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-f0c53bce-a0be-44b5-8f9f-f21a45c6cbe6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:29.328481 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-f0c53bce-a0be-44b5-8f9f-f21a45c6cbe6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:29.337108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f0c53bce-a0be-44b5-8f9f-f21a45c6cbe6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:29.337596 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f0c53bce-a0be-44b5-8f9f-f21a45c6cbe6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:29.338024 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f0c53bce-a0be-44b5-8f9f-f21a45c6cbe6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:29.338737 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f0c53bce-a0be-44b5-8f9f-f21a45c6cbe6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:29.339201 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f0c53bce-a0be-44b5-8f9f-f21a45c6cbe6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:29.339780 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f0c53bce-a0be-44b5-8f9f-f21a45c6cbe6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:29.512282 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f0c53bce-a0be-44b5-8f9f-f21a45c6cbe6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:29.523445 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f0c53bce-a0be-44b5-8f9f-f21a45c6cbe6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:29.525144 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f0c53bce-a0be-44b5-8f9f-f21a45c6cbe6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:29.526159 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-f0c53bce-a0be-44b5-8f9f-f21a45c6cbe6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.204000 Sep 05 12:32:29.527601 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 250/496] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:29 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:29.906979 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0e971120-b136-42a3-9b98-1a55cb6345d4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:29.907860 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0e971120-b136-42a3-9b98-1a55cb6345d4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:29.914208 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e971120-b136-42a3-9b98-1a55cb6345d4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:29.914726 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e971120-b136-42a3-9b98-1a55cb6345d4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:29.915166 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e971120-b136-42a3-9b98-1a55cb6345d4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:29.915932 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e971120-b136-42a3-9b98-1a55cb6345d4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:29.916412 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e971120-b136-42a3-9b98-1a55cb6345d4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:29.916896 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e971120-b136-42a3-9b98-1a55cb6345d4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:30.086081 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0e971120-b136-42a3-9b98-1a55cb6345d4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:30.094322 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0e971120-b136-42a3-9b98-1a55cb6345d4 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1314 microversion: 2.1 time: 0.191694 Sep 05 12:32:30.095686 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 247/497] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:29 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:30.556355 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-813469dc-d021-4206-b913-af2240e0e7b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:30.556999 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-813469dc-d021-4206-b913-af2240e0e7b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:30.563517 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-813469dc-d021-4206-b913-af2240e0e7b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:30.564021 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-813469dc-d021-4206-b913-af2240e0e7b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:30.564449 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-813469dc-d021-4206-b913-af2240e0e7b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:30.565176 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-813469dc-d021-4206-b913-af2240e0e7b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:30.565619 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-813469dc-d021-4206-b913-af2240e0e7b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:30.566035 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-813469dc-d021-4206-b913-af2240e0e7b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:30.729392 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-813469dc-d021-4206-b913-af2240e0e7b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:30.739031 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-813469dc-d021-4206-b913-af2240e0e7b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:30.740511 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-813469dc-d021-4206-b913-af2240e0e7b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:30.741759 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-813469dc-d021-4206-b913-af2240e0e7b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.190991 Sep 05 12:32:30.749512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 251/498] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:30 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:31.118537 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7a7b597b-00d4-4b90-8714-71c371d7f12c tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:31.119155 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-7a7b597b-00d4-4b90-8714-71c371d7f12c tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:31.126080 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7a7b597b-00d4-4b90-8714-71c371d7f12c tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:31.126560 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7a7b597b-00d4-4b90-8714-71c371d7f12c tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:31.126989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7a7b597b-00d4-4b90-8714-71c371d7f12c tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:31.127727 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7a7b597b-00d4-4b90-8714-71c371d7f12c tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:31.128204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7a7b597b-00d4-4b90-8714-71c371d7f12c tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:31.128625 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7a7b597b-00d4-4b90-8714-71c371d7f12c tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:31.320183 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-7a7b597b-00d4-4b90-8714-71c371d7f12c tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:31.328045 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-7a7b597b-00d4-4b90-8714-71c371d7f12c tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1314 microversion: 2.1 time: 0.213991 Sep 05 12:32:31.328615 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 248/499] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:31 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:31.768817 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-b547d37d-c192-4c05-abe3-bc64601ae960 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:31.769681 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-b547d37d-c192-4c05-abe3-bc64601ae960 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:31.776668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b547d37d-c192-4c05-abe3-bc64601ae960 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:31.777180 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b547d37d-c192-4c05-abe3-bc64601ae960 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:31.777710 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b547d37d-c192-4c05-abe3-bc64601ae960 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:31.778495 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b547d37d-c192-4c05-abe3-bc64601ae960 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:31.779283 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b547d37d-c192-4c05-abe3-bc64601ae960 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:31.779736 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b547d37d-c192-4c05-abe3-bc64601ae960 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:31.938960 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-b547d37d-c192-4c05-abe3-bc64601ae960 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:31.952290 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-b547d37d-c192-4c05-abe3-bc64601ae960 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:31.955095 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-b547d37d-c192-4c05-abe3-bc64601ae960 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:31.956911 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-b547d37d-c192-4c05-abe3-bc64601ae960 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.193042 Sep 05 12:32:31.968335 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 252/500] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:31 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:32.351197 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c02c3f2f-7c38-43cf-8e70-b89a2b4ad0a6 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:32.351879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-c02c3f2f-7c38-43cf-8e70-b89a2b4ad0a6 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:32.359330 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c02c3f2f-7c38-43cf-8e70-b89a2b4ad0a6 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:32.359835 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c02c3f2f-7c38-43cf-8e70-b89a2b4ad0a6 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:32.360262 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c02c3f2f-7c38-43cf-8e70-b89a2b4ad0a6 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:32.360956 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c02c3f2f-7c38-43cf-8e70-b89a2b4ad0a6 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:32.361404 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c02c3f2f-7c38-43cf-8e70-b89a2b4ad0a6 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:32.361821 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c02c3f2f-7c38-43cf-8e70-b89a2b4ad0a6 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:32.517443 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c02c3f2f-7c38-43cf-8e70-b89a2b4ad0a6 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:32.527384 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-c02c3f2f-7c38-43cf-8e70-b89a2b4ad0a6 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1314 microversion: 2.1 time: 0.179918 Sep 05 12:32:32.528149 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 249/501] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:32 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:32.989286 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-aa82c53a-b55e-4d1e-b96a-cc8c57d12d0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:32.989927 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-aa82c53a-b55e-4d1e-b96a-cc8c57d12d0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:32.997706 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aa82c53a-b55e-4d1e-b96a-cc8c57d12d0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:32.998190 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aa82c53a-b55e-4d1e-b96a-cc8c57d12d0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:32.998649 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aa82c53a-b55e-4d1e-b96a-cc8c57d12d0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:32.999389 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aa82c53a-b55e-4d1e-b96a-cc8c57d12d0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:32.999865 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aa82c53a-b55e-4d1e-b96a-cc8c57d12d0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:33.004654 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aa82c53a-b55e-4d1e-b96a-cc8c57d12d0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:33.144703 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-aa82c53a-b55e-4d1e-b96a-cc8c57d12d0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:33.153893 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-aa82c53a-b55e-4d1e-b96a-cc8c57d12d0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:33.155600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-aa82c53a-b55e-4d1e-b96a-cc8c57d12d0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:33.157015 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-aa82c53a-b55e-4d1e-b96a-cc8c57d12d0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.171501 Sep 05 12:32:33.157649 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 253/502] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:32 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:33.552045 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-2f247814-e701-4fc5-abf9-12f7119605ee tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:33.553016 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-2f247814-e701-4fc5-abf9-12f7119605ee tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:33.559862 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2f247814-e701-4fc5-abf9-12f7119605ee tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:33.560350 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2f247814-e701-4fc5-abf9-12f7119605ee tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:33.560785 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2f247814-e701-4fc5-abf9-12f7119605ee tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:33.561492 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2f247814-e701-4fc5-abf9-12f7119605ee tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:33.561946 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2f247814-e701-4fc5-abf9-12f7119605ee tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:33.562397 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2f247814-e701-4fc5-abf9-12f7119605ee tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:33.701156 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-2f247814-e701-4fc5-abf9-12f7119605ee tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:33.710294 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-2f247814-e701-4fc5-abf9-12f7119605ee tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1314 microversion: 2.1 time: 0.162072 Sep 05 12:32:33.711557 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 250/503] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:33 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:34.182995 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-39c5680b-1f18-448c-b927-1345e0c74afd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:34.183623 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-39c5680b-1f18-448c-b927-1345e0c74afd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:34.190256 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-39c5680b-1f18-448c-b927-1345e0c74afd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:34.190861 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-39c5680b-1f18-448c-b927-1345e0c74afd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:34.191298 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-39c5680b-1f18-448c-b927-1345e0c74afd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:34.192017 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-39c5680b-1f18-448c-b927-1345e0c74afd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:34.192465 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-39c5680b-1f18-448c-b927-1345e0c74afd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:34.192886 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-39c5680b-1f18-448c-b927-1345e0c74afd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:34.336768 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-39c5680b-1f18-448c-b927-1345e0c74afd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:34.349483 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-39c5680b-1f18-448c-b927-1345e0c74afd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:34.351468 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-39c5680b-1f18-448c-b927-1345e0c74afd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:34.352968 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-39c5680b-1f18-448c-b927-1345e0c74afd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.174442 Sep 05 12:32:34.368051 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 254/504] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:34 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:34.734502 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-bca05a3c-3afd-4a92-b282-f546e85e0c1b tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:34.735079 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-bca05a3c-3afd-4a92-b282-f546e85e0c1b tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:34.741735 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bca05a3c-3afd-4a92-b282-f546e85e0c1b tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:34.742227 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bca05a3c-3afd-4a92-b282-f546e85e0c1b tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:34.743166 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bca05a3c-3afd-4a92-b282-f546e85e0c1b tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:34.743908 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bca05a3c-3afd-4a92-b282-f546e85e0c1b tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:34.744374 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bca05a3c-3afd-4a92-b282-f546e85e0c1b tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:34.744804 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bca05a3c-3afd-4a92-b282-f546e85e0c1b tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:34.926283 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-bca05a3c-3afd-4a92-b282-f546e85e0c1b tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:34.936296 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-bca05a3c-3afd-4a92-b282-f546e85e0c1b tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1314 microversion: 2.1 time: 0.205954 Sep 05 12:32:34.937741 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 251/505] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:34 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:35.387881 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e5410404-b4d7-4c89-8a22-c9883cc83019 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:35.389792 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-e5410404-b4d7-4c89-8a22-c9883cc83019 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:35.399426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e5410404-b4d7-4c89-8a22-c9883cc83019 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:35.400490 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e5410404-b4d7-4c89-8a22-c9883cc83019 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:35.401144 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e5410404-b4d7-4c89-8a22-c9883cc83019 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:35.402292 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e5410404-b4d7-4c89-8a22-c9883cc83019 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:35.402895 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e5410404-b4d7-4c89-8a22-c9883cc83019 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:35.403649 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e5410404-b4d7-4c89-8a22-c9883cc83019 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:35.558183 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-e5410404-b4d7-4c89-8a22-c9883cc83019 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:35.567621 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-e5410404-b4d7-4c89-8a22-c9883cc83019 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:35.569113 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-e5410404-b4d7-4c89-8a22-c9883cc83019 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:35.570285 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-e5410404-b4d7-4c89-8a22-c9883cc83019 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.192007 Sep 05 12:32:35.570834 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 255/506] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:35 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:35.960796 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ffc7da12-0786-49bf-acad-3d6ac99fb632 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:35.961873 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ffc7da12-0786-49bf-acad-3d6ac99fb632 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:35.969046 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ffc7da12-0786-49bf-acad-3d6ac99fb632 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:35.969628 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ffc7da12-0786-49bf-acad-3d6ac99fb632 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:35.970003 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ffc7da12-0786-49bf-acad-3d6ac99fb632 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:35.970767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ffc7da12-0786-49bf-acad-3d6ac99fb632 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:35.971238 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ffc7da12-0786-49bf-acad-3d6ac99fb632 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:35.971701 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ffc7da12-0786-49bf-acad-3d6ac99fb632 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:36.161470 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ffc7da12-0786-49bf-acad-3d6ac99fb632 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:36.174352 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ffc7da12-0786-49bf-acad-3d6ac99fb632 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1314 microversion: 2.1 time: 0.217509 Sep 05 12:32:36.174942 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 252/507] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:35 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:36.596866 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-186d9d87-4341-4d54-8f86-aa0487474de4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:36.597965 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-186d9d87-4341-4d54-8f86-aa0487474de4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:36.606735 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-186d9d87-4341-4d54-8f86-aa0487474de4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:36.607435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-186d9d87-4341-4d54-8f86-aa0487474de4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:36.608087 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-186d9d87-4341-4d54-8f86-aa0487474de4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:36.609040 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-186d9d87-4341-4d54-8f86-aa0487474de4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:36.609613 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-186d9d87-4341-4d54-8f86-aa0487474de4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:36.610229 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-186d9d87-4341-4d54-8f86-aa0487474de4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:36.758056 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-186d9d87-4341-4d54-8f86-aa0487474de4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:36.767382 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-186d9d87-4341-4d54-8f86-aa0487474de4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:36.768844 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-186d9d87-4341-4d54-8f86-aa0487474de4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:36.769998 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-186d9d87-4341-4d54-8f86-aa0487474de4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.177791 Sep 05 12:32:36.770563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 256/508] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:36 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:37.207845 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0e5d56d5-a522-45e5-93f7-63aa6e34e955 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:37.209401 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0e5d56d5-a522-45e5-93f7-63aa6e34e955 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:37.221312 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e5d56d5-a522-45e5-93f7-63aa6e34e955 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:37.221734 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e5d56d5-a522-45e5-93f7-63aa6e34e955 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:37.222176 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e5d56d5-a522-45e5-93f7-63aa6e34e955 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:37.222898 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e5d56d5-a522-45e5-93f7-63aa6e34e955 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:37.223360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e5d56d5-a522-45e5-93f7-63aa6e34e955 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:37.223817 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e5d56d5-a522-45e5-93f7-63aa6e34e955 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:37.393262 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0e5d56d5-a522-45e5-93f7-63aa6e34e955 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:37.397804 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=100 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:37.401869 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0e5d56d5-a522-45e5-93f7-63aa6e34e955 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1314 microversion: 2.1 time: 0.201001 Sep 05 12:32:37.402500 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 253/509] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:37 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:37.797531 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-c13961a6-b7bd-452c-ac5b-4e4f0ec4a500 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:37.798114 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-c13961a6-b7bd-452c-ac5b-4e4f0ec4a500 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:37.800575 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:37.805342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c13961a6-b7bd-452c-ac5b-4e4f0ec4a500 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:37.805829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c13961a6-b7bd-452c-ac5b-4e4f0ec4a500 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:37.806991 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c13961a6-b7bd-452c-ac5b-4e4f0ec4a500 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:37.807731 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c13961a6-b7bd-452c-ac5b-4e4f0ec4a500 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:37.808184 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c13961a6-b7bd-452c-ac5b-4e4f0ec4a500 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:37.815745 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c13961a6-b7bd-452c-ac5b-4e4f0ec4a500 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:37.994241 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c13961a6-b7bd-452c-ac5b-4e4f0ec4a500 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:38.008705 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c13961a6-b7bd-452c-ac5b-4e4f0ec4a500 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:38.012528 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c13961a6-b7bd-452c-ac5b-4e4f0ec4a500 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:38.012528 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-c13961a6-b7bd-452c-ac5b-4e4f0ec4a500 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.218141 Sep 05 12:32:38.012528 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 257/510] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:37 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:32:38.425493 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-060a386f-5785-4357-a21b-b5f616b725cf tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:38.426068 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-060a386f-5785-4357-a21b-b5f616b725cf tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:38.434295 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-060a386f-5785-4357-a21b-b5f616b725cf tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:38.435160 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-060a386f-5785-4357-a21b-b5f616b725cf tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:38.435902 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-060a386f-5785-4357-a21b-b5f616b725cf tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:38.436698 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-060a386f-5785-4357-a21b-b5f616b725cf tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:38.437397 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-060a386f-5785-4357-a21b-b5f616b725cf tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:38.437904 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-060a386f-5785-4357-a21b-b5f616b725cf tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:38.587985 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-060a386f-5785-4357-a21b-b5f616b725cf tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:38.602842 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-060a386f-5785-4357-a21b-b5f616b725cf tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1314 microversion: 2.1 time: 0.181522 Sep 05 12:32:38.603977 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 254/511] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:38 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:39.038794 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-99f7c297-59c6-4feb-ac63-ffa5173c6ce1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:39.039472 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-99f7c297-59c6-4feb-ac63-ffa5173c6ce1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:39.046210 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-99f7c297-59c6-4feb-ac63-ffa5173c6ce1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:39.046765 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-99f7c297-59c6-4feb-ac63-ffa5173c6ce1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:39.047282 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-99f7c297-59c6-4feb-ac63-ffa5173c6ce1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:39.048129 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-99f7c297-59c6-4feb-ac63-ffa5173c6ce1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:39.048578 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-99f7c297-59c6-4feb-ac63-ffa5173c6ce1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:39.048994 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-99f7c297-59c6-4feb-ac63-ffa5173c6ce1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:39.192266 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-99f7c297-59c6-4feb-ac63-ffa5173c6ce1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:39.211069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-99f7c297-59c6-4feb-ac63-ffa5173c6ce1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:39.212589 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-99f7c297-59c6-4feb-ac63-ffa5173c6ce1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:39.213784 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-99f7c297-59c6-4feb-ac63-ffa5173c6ce1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.179315 Sep 05 12:32:39.223572 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 258/512] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:39 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:32:39.627741 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a737cf24-3c44-4074-9d1c-90eb0e3f8034 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:39.628365 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a737cf24-3c44-4074-9d1c-90eb0e3f8034 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:39.634768 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a737cf24-3c44-4074-9d1c-90eb0e3f8034 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:39.635245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a737cf24-3c44-4074-9d1c-90eb0e3f8034 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:39.635712 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a737cf24-3c44-4074-9d1c-90eb0e3f8034 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:39.636396 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a737cf24-3c44-4074-9d1c-90eb0e3f8034 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:39.636876 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a737cf24-3c44-4074-9d1c-90eb0e3f8034 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:39.637300 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a737cf24-3c44-4074-9d1c-90eb0e3f8034 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:39.784990 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a737cf24-3c44-4074-9d1c-90eb0e3f8034 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:39.793518 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a737cf24-3c44-4074-9d1c-90eb0e3f8034 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1314 microversion: 2.1 time: 0.169965 Sep 05 12:32:39.794076 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 255/513] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:39 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:40.240464 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-f9d8a552-65fa-4c81-bfe2-cb1a7fab8218 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:40.241084 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-f9d8a552-65fa-4c81-bfe2-cb1a7fab8218 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:40.247772 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f9d8a552-65fa-4c81-bfe2-cb1a7fab8218 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:40.248262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f9d8a552-65fa-4c81-bfe2-cb1a7fab8218 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:40.248698 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f9d8a552-65fa-4c81-bfe2-cb1a7fab8218 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:40.249403 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f9d8a552-65fa-4c81-bfe2-cb1a7fab8218 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:40.249861 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f9d8a552-65fa-4c81-bfe2-cb1a7fab8218 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:40.250281 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f9d8a552-65fa-4c81-bfe2-cb1a7fab8218 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:40.389490 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f9d8a552-65fa-4c81-bfe2-cb1a7fab8218 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:40.399565 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f9d8a552-65fa-4c81-bfe2-cb1a7fab8218 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:40.401108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f9d8a552-65fa-4c81-bfe2-cb1a7fab8218 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:40.402274 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-f9d8a552-65fa-4c81-bfe2-cb1a7fab8218 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.165711 Sep 05 12:32:40.403950 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 259/514] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:40 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:40.817015 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-75a2bffa-36a6-4d48-9416-a8d0dc51f554 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:40.817624 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-75a2bffa-36a6-4d48-9416-a8d0dc51f554 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:40.819833 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:40.824718 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-75a2bffa-36a6-4d48-9416-a8d0dc51f554 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:40.825193 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-75a2bffa-36a6-4d48-9416-a8d0dc51f554 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:40.825948 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-75a2bffa-36a6-4d48-9416-a8d0dc51f554 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:40.826640 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-75a2bffa-36a6-4d48-9416-a8d0dc51f554 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:40.827096 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-75a2bffa-36a6-4d48-9416-a8d0dc51f554 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:40.827607 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-75a2bffa-36a6-4d48-9416-a8d0dc51f554 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:40.960812 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-75a2bffa-36a6-4d48-9416-a8d0dc51f554 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:40.968552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-75a2bffa-36a6-4d48-9416-a8d0dc51f554 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1314 microversion: 2.1 time: 0.155997 Sep 05 12:32:40.969361 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 256/515] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:40 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:41.428254 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-26c56c5b-2c7a-4893-aaf3-1437a9d6d23d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:41.428869 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-26c56c5b-2c7a-4893-aaf3-1437a9d6d23d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:41.435440 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-26c56c5b-2c7a-4893-aaf3-1437a9d6d23d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:41.435954 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-26c56c5b-2c7a-4893-aaf3-1437a9d6d23d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:41.436388 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-26c56c5b-2c7a-4893-aaf3-1437a9d6d23d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:41.437084 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-26c56c5b-2c7a-4893-aaf3-1437a9d6d23d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:41.437535 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-26c56c5b-2c7a-4893-aaf3-1437a9d6d23d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:41.437956 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-26c56c5b-2c7a-4893-aaf3-1437a9d6d23d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:41.442003 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=100 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:41.575274 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-26c56c5b-2c7a-4893-aaf3-1437a9d6d23d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:41.583851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-26c56c5b-2c7a-4893-aaf3-1437a9d6d23d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:41.585327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-26c56c5b-2c7a-4893-aaf3-1437a9d6d23d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:41.586474 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-26c56c5b-2c7a-4893-aaf3-1437a9d6d23d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.162136 Sep 05 12:32:41.587025 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 260/516] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:41 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:41.992943 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7a36ad1c-a843-4532-bd02-95fae3d61ed3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:41.994038 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-7a36ad1c-a843-4532-bd02-95fae3d61ed3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:42.001513 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7a36ad1c-a843-4532-bd02-95fae3d61ed3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:42.002026 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7a36ad1c-a843-4532-bd02-95fae3d61ed3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:42.002457 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7a36ad1c-a843-4532-bd02-95fae3d61ed3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:42.003154 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7a36ad1c-a843-4532-bd02-95fae3d61ed3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:42.003638 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7a36ad1c-a843-4532-bd02-95fae3d61ed3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:42.004061 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7a36ad1c-a843-4532-bd02-95fae3d61ed3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:42.152040 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-7a36ad1c-a843-4532-bd02-95fae3d61ed3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:42.159725 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-7a36ad1c-a843-4532-bd02-95fae3d61ed3 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1314 microversion: 2.1 time: 0.170730 Sep 05 12:32:42.160300 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 257/517] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:41 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:42.612515 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-92df6d61-e5b2-46e0-982b-ce0870e72a17 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:42.613053 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-92df6d61-e5b2-46e0-982b-ce0870e72a17 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:42.620061 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-92df6d61-e5b2-46e0-982b-ce0870e72a17 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:42.620536 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-92df6d61-e5b2-46e0-982b-ce0870e72a17 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:42.620957 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-92df6d61-e5b2-46e0-982b-ce0870e72a17 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:42.621633 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-92df6d61-e5b2-46e0-982b-ce0870e72a17 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:42.622075 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-92df6d61-e5b2-46e0-982b-ce0870e72a17 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:42.622486 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-92df6d61-e5b2-46e0-982b-ce0870e72a17 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:42.752223 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-92df6d61-e5b2-46e0-982b-ce0870e72a17 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:42.761626 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-92df6d61-e5b2-46e0-982b-ce0870e72a17 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:42.763119 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-92df6d61-e5b2-46e0-982b-ce0870e72a17 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:42.764299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-92df6d61-e5b2-46e0-982b-ce0870e72a17 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.155788 Sep 05 12:32:42.764851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 261/518] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:42 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:43.182376 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4b34f08e-ebc3-4b63-a5d3-1416759ba39d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:43.182990 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4b34f08e-ebc3-4b63-a5d3-1416759ba39d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:43.189716 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4b34f08e-ebc3-4b63-a5d3-1416759ba39d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:43.190206 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4b34f08e-ebc3-4b63-a5d3-1416759ba39d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:43.190641 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4b34f08e-ebc3-4b63-a5d3-1416759ba39d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:43.191369 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4b34f08e-ebc3-4b63-a5d3-1416759ba39d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:43.191831 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4b34f08e-ebc3-4b63-a5d3-1416759ba39d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:43.192261 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4b34f08e-ebc3-4b63-a5d3-1416759ba39d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:43.328864 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-4b34f08e-ebc3-4b63-a5d3-1416759ba39d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:43.336998 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4b34f08e-ebc3-4b63-a5d3-1416759ba39d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1463 microversion: 2.1 time: 0.158506 Sep 05 12:32:43.338151 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 258/519] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:43 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:43.385914 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a80d9478-29a4-40ba-926d-b6127e2d2eca tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:43.386441 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a80d9478-29a4-40ba-926d-b6127e2d2eca tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:43.392843 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a80d9478-29a4-40ba-926d-b6127e2d2eca tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:43.393329 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a80d9478-29a4-40ba-926d-b6127e2d2eca tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:43.393759 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a80d9478-29a4-40ba-926d-b6127e2d2eca tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:43.394466 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a80d9478-29a4-40ba-926d-b6127e2d2eca tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:43.394913 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a80d9478-29a4-40ba-926d-b6127e2d2eca tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:43.395336 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a80d9478-29a4-40ba-926d-b6127e2d2eca tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:43.423064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a80d9478-29a4-40ba-926d-b6127e2d2eca tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Going to try to terminate instance {{(pid=121210) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:32:43.726621 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a80d9478-29a4-40ba-926d-b6127e2d2eca tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 204 len: 0 microversion: 2.1 time: 0.344987 Sep 05 12:32:43.727287 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 262/520] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:32:43 2022] DELETE /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:32:43.736086 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-21265b47-6f5e-4357-899b-95d47a87a99d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:43.736694 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-21265b47-6f5e-4357-899b-95d47a87a99d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:43.742739 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-21265b47-6f5e-4357-899b-95d47a87a99d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:43.743221 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-21265b47-6f5e-4357-899b-95d47a87a99d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:43.744229 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-21265b47-6f5e-4357-899b-95d47a87a99d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:43.744914 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-21265b47-6f5e-4357-899b-95d47a87a99d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:43.745366 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-21265b47-6f5e-4357-899b-95d47a87a99d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:43.745785 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-21265b47-6f5e-4357-899b-95d47a87a99d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:43.791435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-6b9f364e-89c5-4adc-9c44-dbd93cd7685b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:43.792235 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-6b9f364e-89c5-4adc-9c44-dbd93cd7685b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:43.798375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6b9f364e-89c5-4adc-9c44-dbd93cd7685b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:43.798857 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6b9f364e-89c5-4adc-9c44-dbd93cd7685b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:43.799288 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6b9f364e-89c5-4adc-9c44-dbd93cd7685b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:43.800034 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6b9f364e-89c5-4adc-9c44-dbd93cd7685b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:43.800480 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6b9f364e-89c5-4adc-9c44-dbd93cd7685b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:43.800896 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6b9f364e-89c5-4adc-9c44-dbd93cd7685b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:43.886444 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-21265b47-6f5e-4357-899b-95d47a87a99d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:43.894611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-21265b47-6f5e-4357-899b-95d47a87a99d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1469 microversion: 2.1 time: 0.162353 Sep 05 12:32:43.895190 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 259/521] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:43 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1469 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:32:43.938417 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6b9f364e-89c5-4adc-9c44-dbd93cd7685b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:43.947710 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6b9f364e-89c5-4adc-9c44-dbd93cd7685b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:43.949549 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6b9f364e-89c5-4adc-9c44-dbd93cd7685b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:43.950591 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-6b9f364e-89c5-4adc-9c44-dbd93cd7685b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.164075 Sep 05 12:32:43.951161 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 263/522] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:43 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:32:44.917958 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-6e6db275-6226-4355-8848-463ff6d60018 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:44.918566 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-6e6db275-6226-4355-8848-463ff6d60018 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:44.925267 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6e6db275-6226-4355-8848-463ff6d60018 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:44.925747 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6e6db275-6226-4355-8848-463ff6d60018 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:44.926182 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6e6db275-6226-4355-8848-463ff6d60018 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:44.926869 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6e6db275-6226-4355-8848-463ff6d60018 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:44.927326 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6e6db275-6226-4355-8848-463ff6d60018 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:44.927782 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6e6db275-6226-4355-8848-463ff6d60018 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:44.979187 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-972f312f-f299-496a-9f95-49ffa71fdfcd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:44.980213 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-972f312f-f299-496a-9f95-49ffa71fdfcd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:44.991241 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-972f312f-f299-496a-9f95-49ffa71fdfcd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:44.991778 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-972f312f-f299-496a-9f95-49ffa71fdfcd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:44.992207 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-972f312f-f299-496a-9f95-49ffa71fdfcd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:44.992913 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-972f312f-f299-496a-9f95-49ffa71fdfcd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:44.994105 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-972f312f-f299-496a-9f95-49ffa71fdfcd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:44.995486 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-972f312f-f299-496a-9f95-49ffa71fdfcd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:45.075596 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6e6db275-6226-4355-8848-463ff6d60018 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:45.086841 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-6e6db275-6226-4355-8848-463ff6d60018 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1469 microversion: 2.1 time: 0.172703 Sep 05 12:32:45.087442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 260/523] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:44 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1469 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:45.153717 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-972f312f-f299-496a-9f95-49ffa71fdfcd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:45.162798 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-972f312f-f299-496a-9f95-49ffa71fdfcd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:45.164367 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-972f312f-f299-496a-9f95-49ffa71fdfcd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:45.165605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-972f312f-f299-496a-9f95-49ffa71fdfcd tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.191538 Sep 05 12:32:45.166157 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 264/524] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:44 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:46.110792 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-017fb580-75b4-482d-b400-e42f31ee909b tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:46.111410 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-017fb580-75b4-482d-b400-e42f31ee909b tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:46.120432 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-017fb580-75b4-482d-b400-e42f31ee909b tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:46.120432 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-017fb580-75b4-482d-b400-e42f31ee909b tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:46.120432 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-017fb580-75b4-482d-b400-e42f31ee909b tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:46.120432 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-017fb580-75b4-482d-b400-e42f31ee909b tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:46.120960 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-017fb580-75b4-482d-b400-e42f31ee909b tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:46.121090 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-017fb580-75b4-482d-b400-e42f31ee909b tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:46.192119 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-620e9982-063d-4d33-be21-012f55ccc328 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:46.192736 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-620e9982-063d-4d33-be21-012f55ccc328 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:46.200133 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-620e9982-063d-4d33-be21-012f55ccc328 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:46.200683 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-620e9982-063d-4d33-be21-012f55ccc328 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:46.201123 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-620e9982-063d-4d33-be21-012f55ccc328 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:46.201836 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-620e9982-063d-4d33-be21-012f55ccc328 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:46.202296 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-620e9982-063d-4d33-be21-012f55ccc328 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:46.202722 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-620e9982-063d-4d33-be21-012f55ccc328 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:46.324728 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-017fb580-75b4-482d-b400-e42f31ee909b tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:46.335290 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-017fb580-75b4-482d-b400-e42f31ee909b tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1469 microversion: 2.1 time: 0.228742 Sep 05 12:32:46.336031 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 261/525] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:46 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1469 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:46.343800 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-620e9982-063d-4d33-be21-012f55ccc328 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:46.353094 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-620e9982-063d-4d33-be21-012f55ccc328 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:46.354558 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-620e9982-063d-4d33-be21-012f55ccc328 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:46.355753 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-620e9982-063d-4d33-be21-012f55ccc328 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.167649 Sep 05 12:32:46.356566 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 265/526] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:46 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:32:46.520430 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-d0fc7896-fba9-4145-b3d0-3f6c96e487ec req-12eaf8a7-14cf-4789-ae15-198f2fabdfda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6783eb5-1683-4222-9f06-774719632959", "name": "network-vif-deleted", "tag": "d8fd2312-4b92-4447-905d-b0a66194e316"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:46.530353 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-d0fc7896-fba9-4145-b3d0-3f6c96e487ec req-12eaf8a7-14cf-4789-ae15-198f2fabdfda service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:46.530900 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-d0fc7896-fba9-4145-b3d0-3f6c96e487ec req-12eaf8a7-14cf-4789-ae15-198f2fabdfda service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:46.531327 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-d0fc7896-fba9-4145-b3d0-3f6c96e487ec req-12eaf8a7-14cf-4789-ae15-198f2fabdfda service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:46.543094 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-d0fc7896-fba9-4145-b3d0-3f6c96e487ec req-12eaf8a7-14cf-4789-ae15-198f2fabdfda service nova] Creating event network-vif-deleted:d8fd2312-4b92-4447-905d-b0a66194e316 for instance b6783eb5-1683-4222-9f06-774719632959 on hv-cinder-80135 Sep 05 12:32:46.548581 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-d0fc7896-fba9-4145-b3d0-3f6c96e487ec req-12eaf8a7-14cf-4789-ae15-198f2fabdfda service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031821 Sep 05 12:32:46.549433 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 262/527] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:32:47.363840 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-5bdb7fc4-0629-4a5a-8ebd-05e4faf1dd53 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:47.364391 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-5bdb7fc4-0629-4a5a-8ebd-05e4faf1dd53 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:47.371236 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5bdb7fc4-0629-4a5a-8ebd-05e4faf1dd53 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:47.371743 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5bdb7fc4-0629-4a5a-8ebd-05e4faf1dd53 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:47.372173 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5bdb7fc4-0629-4a5a-8ebd-05e4faf1dd53 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:47.372851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5bdb7fc4-0629-4a5a-8ebd-05e4faf1dd53 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:47.373298 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5bdb7fc4-0629-4a5a-8ebd-05e4faf1dd53 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:47.373711 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5bdb7fc4-0629-4a5a-8ebd-05e4faf1dd53 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:47.382578 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a2b44fb1-6355-43e9-a2d1-8873ca921e88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:47.383755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a2b44fb1-6355-43e9-a2d1-8873ca921e88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:47.391034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a2b44fb1-6355-43e9-a2d1-8873ca921e88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:47.391621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a2b44fb1-6355-43e9-a2d1-8873ca921e88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:47.392006 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a2b44fb1-6355-43e9-a2d1-8873ca921e88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:47.392698 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a2b44fb1-6355-43e9-a2d1-8873ca921e88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:47.393154 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a2b44fb1-6355-43e9-a2d1-8873ca921e88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:47.393579 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a2b44fb1-6355-43e9-a2d1-8873ca921e88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:47.435123 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-5bdb7fc4-0629-4a5a-8ebd-05e4faf1dd53 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:47.442952 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-5bdb7fc4-0629-4a5a-8ebd-05e4faf1dd53 tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1427 microversion: 2.1 time: 0.083018 Sep 05 12:32:47.443526 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 266/528] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:47 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:47.522609 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a2b44fb1-6355-43e9-a2d1-8873ca921e88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:47.531212 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a2b44fb1-6355-43e9-a2d1-8873ca921e88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:47.532696 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a2b44fb1-6355-43e9-a2d1-8873ca921e88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:47.533861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a2b44fb1-6355-43e9-a2d1-8873ca921e88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.155539 Sep 05 12:32:47.534416 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 263/529] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:47 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:32:48.467513 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-17d24d7b-f341-48fc-b588-3cfc9fdfa84f tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:48.468065 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-17d24d7b-f341-48fc-b588-3cfc9fdfa84f tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:48.474455 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-17d24d7b-f341-48fc-b588-3cfc9fdfa84f tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:48.474929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-17d24d7b-f341-48fc-b588-3cfc9fdfa84f tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:48.475354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-17d24d7b-f341-48fc-b588-3cfc9fdfa84f tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:48.476068 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-17d24d7b-f341-48fc-b588-3cfc9fdfa84f tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:48.476565 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-17d24d7b-f341-48fc-b588-3cfc9fdfa84f tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:48.476984 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-17d24d7b-f341-48fc-b588-3cfc9fdfa84f tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:48.539371 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-17d24d7b-f341-48fc-b588-3cfc9fdfa84f tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:48.547240 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-17d24d7b-f341-48fc-b588-3cfc9fdfa84f tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1427 microversion: 2.1 time: 0.083721 Sep 05 12:32:48.553511 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 267/530] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:48 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:48.560501 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c2580b8a-ce82-43f3-bb35-50d8a3b2126a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:48.561119 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-c2580b8a-ce82-43f3-bb35-50d8a3b2126a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:48.567888 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c2580b8a-ce82-43f3-bb35-50d8a3b2126a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:48.568380 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c2580b8a-ce82-43f3-bb35-50d8a3b2126a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:48.568821 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c2580b8a-ce82-43f3-bb35-50d8a3b2126a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:48.569519 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c2580b8a-ce82-43f3-bb35-50d8a3b2126a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:48.569973 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c2580b8a-ce82-43f3-bb35-50d8a3b2126a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:48.570555 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c2580b8a-ce82-43f3-bb35-50d8a3b2126a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:48.705801 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c2580b8a-ce82-43f3-bb35-50d8a3b2126a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:48.714372 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c2580b8a-ce82-43f3-bb35-50d8a3b2126a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:48.715867 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c2580b8a-ce82-43f3-bb35-50d8a3b2126a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:48.717026 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-c2580b8a-ce82-43f3-bb35-50d8a3b2126a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.160598 Sep 05 12:32:48.717639 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 264/531] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:48 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:49.570795 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d585852b-1219-4914-abe1-10686d0aa26a tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:49.571385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d585852b-1219-4914-abe1-10686d0aa26a tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:49.578124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d585852b-1219-4914-abe1-10686d0aa26a tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:49.578607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d585852b-1219-4914-abe1-10686d0aa26a tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:49.579030 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d585852b-1219-4914-abe1-10686d0aa26a tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:49.579762 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d585852b-1219-4914-abe1-10686d0aa26a tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:49.580212 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d585852b-1219-4914-abe1-10686d0aa26a tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:49.580626 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d585852b-1219-4914-abe1-10686d0aa26a tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:49.644975 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d585852b-1219-4914-abe1-10686d0aa26a tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:49.653264 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d585852b-1219-4914-abe1-10686d0aa26a tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1427 microversion: 2.1 time: 0.086586 Sep 05 12:32:49.653837 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 268/532] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:49 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:49.742672 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1cd2cf63-9e05-44ca-b8e3-151038208023 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:49.743274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1cd2cf63-9e05-44ca-b8e3-151038208023 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:49.750418 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1cd2cf63-9e05-44ca-b8e3-151038208023 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:49.750927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1cd2cf63-9e05-44ca-b8e3-151038208023 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:49.751354 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1cd2cf63-9e05-44ca-b8e3-151038208023 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:49.752079 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1cd2cf63-9e05-44ca-b8e3-151038208023 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:49.752526 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1cd2cf63-9e05-44ca-b8e3-151038208023 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:49.752944 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1cd2cf63-9e05-44ca-b8e3-151038208023 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:49.885889 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1cd2cf63-9e05-44ca-b8e3-151038208023 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:49.895288 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1cd2cf63-9e05-44ca-b8e3-151038208023 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:49.896758 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1cd2cf63-9e05-44ca-b8e3-151038208023 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:49.897917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1cd2cf63-9e05-44ca-b8e3-151038208023 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.159309 Sep 05 12:32:49.898477 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 265/533] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:49 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:50.677170 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-fbd3deda-1139-45fd-b544-53e87a07aabb tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:50.677781 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-fbd3deda-1139-45fd-b544-53e87a07aabb tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:50.684976 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fbd3deda-1139-45fd-b544-53e87a07aabb tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:50.685455 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fbd3deda-1139-45fd-b544-53e87a07aabb tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:50.685887 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fbd3deda-1139-45fd-b544-53e87a07aabb tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:50.686609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fbd3deda-1139-45fd-b544-53e87a07aabb tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:50.687061 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fbd3deda-1139-45fd-b544-53e87a07aabb tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:50.687479 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fbd3deda-1139-45fd-b544-53e87a07aabb tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:50.718373 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fbd3deda-1139-45fd-b544-53e87a07aabb tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:50.718858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fbd3deda-1139-45fd-b544-53e87a07aabb tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:50.719285 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fbd3deda-1139-45fd-b544-53e87a07aabb tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:50.719756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-fbd3deda-1139-45fd-b544-53e87a07aabb tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lazy-loading 'fault' on Instance uuid b6783eb5-1683-4222-9f06-774719632959 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:32:50.768152 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-fbd3deda-1139-45fd-b544-53e87a07aabb tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd86ccae798764807976ab6c52b5f50a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ac989524a34d65bcefc990244d02dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:50.775882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-fbd3deda-1139-45fd-b544-53e87a07aabb tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 200 len: 1304 microversion: 2.1 time: 0.102504 Sep 05 12:32:50.776605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 269/534] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:50 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:32:50.924809 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a46fe12f-0a9e-4976-b79e-c4e00f381213 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:50.925522 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a46fe12f-0a9e-4976-b79e-c4e00f381213 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:50.934288 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a46fe12f-0a9e-4976-b79e-c4e00f381213 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:50.935016 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a46fe12f-0a9e-4976-b79e-c4e00f381213 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:50.935565 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a46fe12f-0a9e-4976-b79e-c4e00f381213 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:50.936378 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a46fe12f-0a9e-4976-b79e-c4e00f381213 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:50.936909 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a46fe12f-0a9e-4976-b79e-c4e00f381213 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:50.937409 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a46fe12f-0a9e-4976-b79e-c4e00f381213 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:51.074555 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a46fe12f-0a9e-4976-b79e-c4e00f381213 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:51.085992 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a46fe12f-0a9e-4976-b79e-c4e00f381213 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:51.088065 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a46fe12f-0a9e-4976-b79e-c4e00f381213 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:51.089259 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a46fe12f-0a9e-4976-b79e-c4e00f381213 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.168966 Sep 05 12:32:51.089860 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 266/535] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:50 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:51.799968 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-0d7cd41f-fcb0-415d-b6cb-4d0a49a5870d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:51.800502 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-0d7cd41f-fcb0-415d-b6cb-4d0a49a5870d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] [instance: b6783eb5-1683-4222-9f06-774719632959] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:51.807631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0d7cd41f-fcb0-415d-b6cb-4d0a49a5870d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:51.808112 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0d7cd41f-fcb0-415d-b6cb-4d0a49a5870d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:51.808542 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0d7cd41f-fcb0-415d-b6cb-4d0a49a5870d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:51.809230 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0d7cd41f-fcb0-415d-b6cb-4d0a49a5870d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:51.809679 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0d7cd41f-fcb0-415d-b6cb-4d0a49a5870d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:51.810096 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0d7cd41f-fcb0-415d-b6cb-4d0a49a5870d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:51.823909 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-0d7cd41f-fcb0-415d-b6cb-4d0a49a5870d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] HTTP exception thrown: Instance b6783eb5-1683-4222-9f06-774719632959 could not be found. Sep 05 12:32:51.825570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-0d7cd41f-fcb0-415d-b6cb-4d0a49a5870d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Request method failure captured: Sep 05 12:32:51.825570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 HTTP/1.1 Sep 05 12:32:51.825570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:32:51.825570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:32:51.825570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:32:51.825570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:32:51.825570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:32:51.825570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:32:51.825570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:32:51.825570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:32:51.825570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFexGSc5RCLj6FaEm59nju6tbpJn208DGsdOvYr1IAlg71M1hqyk4XoiTSlUkFNX5XfnAATfHGSsypXiTkODqQeB8n_kcB_4WxBov9phXQ_b_ZWPPe11Ydtkmrw4HHc_0_Wl_ca778bwpx3oVvc9jOkh7Jq5frxHt00mHW8CiUKpQr2s Sep 05 12:32:51.825570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:32:51.825570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:32:51.825570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:32:51.825570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:32:51.825570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:32:51.825570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:32:51.825570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 29ac989524a34d65bcefc990244d02dd Sep 05 12:32:51.825570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-VolumesNegativeTest-1880244658 Sep 05 12:32:51.825570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:32:51.825570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:32:51.827646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/29ac989524a34d65bcefc990244d02dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/29ac989524a34d65bcefc990244d02dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/29ac989524a34d65bcefc990244d02dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_29ac989524a34d65bcefc990244d02dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:32:51.827646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-VolumesNegativeTest-1880244658 Sep 05 12:32:51.827646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 29ac989524a34d65bcefc990244d02dd Sep 05 12:32:51.827646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-VolumesNegativeTest-1880244658 Sep 05 12:32:51.827646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-VolumesNegativeTest-1880244658-project Sep 05 12:32:51.827646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:32:51.827646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:32:51.827646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: d86ccae798764807976ab6c52b5f50a7 Sep 05 12:32:51.827646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-VolumesNegativeTest-1880244658-project Sep 05 12:32:51.827646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:32:51.827646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance b6783eb5-1683-4222-9f06-774719632959 could not be found. Sep 05 12:32:51.827646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': 'b6783eb5-1683-4222-9f06-774719632959'} Sep 05 12:32:51.828774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:32:51.828774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:32:51.828774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:32:51.828774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:32:51.828774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:32:51.828774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:32:51.828774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:32:51.828774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:32:51.828774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:32:51.828774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:32:51.828774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6783eb5-1683-4222-9f06-774719632959 could not be found. Sep 05 12:32:51.828774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:32:51.828774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:32:51.828774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:32:51.828774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:32:51.828774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:32:51.828774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:32:51.828774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:32:51.828774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:32:51.828774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:32:51.830238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:32:51.830238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:32:51.830238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:32:51.830238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:32:51.830238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:32:51.830238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:32:51.830238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:32:51.830238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6783eb5-1683-4222-9f06-774719632959 could not be found. Sep 05 12:32:51.830238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:32:51.830238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:32:51.830238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:32:51.830238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:32:51.830238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:32:51.830238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:32:51.830238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:32:51.830238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:32:51.830238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6783eb5-1683-4222-9f06-774719632959 could not be found. Sep 05 12:32:51.830238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:32:51.831500 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-0d7cd41f-fcb0-415d-b6cb-4d0a49a5870d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] Returning 404 to user: Instance b6783eb5-1683-4222-9f06-774719632959 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:32:51.831500 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-0d7cd41f-fcb0-415d-b6cb-4d0a49a5870d tempest-VolumesNegativeTest-1880244658 tempest-VolumesNegativeTest-1880244658-project] 10.222.0.62 "GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959" status: 404 len: 111 microversion: 2.1 time: 0.031087 Sep 05 12:32:51.831500 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 270/536] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:32:51 2022] GET /compute/v2.1/servers/b6783eb5-1683-4222-9f06-774719632959 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:32:52.115610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ba768a67-1bf0-4013-abb0-4e528377483f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:52.116216 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ba768a67-1bf0-4013-abb0-4e528377483f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:52.123261 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ba768a67-1bf0-4013-abb0-4e528377483f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:52.123798 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ba768a67-1bf0-4013-abb0-4e528377483f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:52.124237 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ba768a67-1bf0-4013-abb0-4e528377483f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:52.124950 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ba768a67-1bf0-4013-abb0-4e528377483f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:52.125408 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ba768a67-1bf0-4013-abb0-4e528377483f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:52.125835 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ba768a67-1bf0-4013-abb0-4e528377483f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:52.266349 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ba768a67-1bf0-4013-abb0-4e528377483f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:52.275292 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ba768a67-1bf0-4013-abb0-4e528377483f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:52.276803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ba768a67-1bf0-4013-abb0-4e528377483f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:52.277972 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ba768a67-1bf0-4013-abb0-4e528377483f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.166338 Sep 05 12:32:52.278532 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 267/537] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:52 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:52.785619 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-314adaeb-e54e-4cbb-9e70-a1c5ef974862 req-f4afe442-a98c-45d0-aa59-bc437df403d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0105c66-6939-4b6d-b774-c1821012c1f0", "name": "network-vif-plugged", "status": "completed", "tag": "09dffb1b-f334-42d1-bd74-8b59ed4648c3"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:32:52.798708 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-314adaeb-e54e-4cbb-9e70-a1c5ef974862 req-f4afe442-a98c-45d0-aa59-bc437df403d1 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:52.798708 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-314adaeb-e54e-4cbb-9e70-a1c5ef974862 req-f4afe442-a98c-45d0-aa59-bc437df403d1 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:52.798893 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-314adaeb-e54e-4cbb-9e70-a1c5ef974862 req-f4afe442-a98c-45d0-aa59-bc437df403d1 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:52.811331 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-314adaeb-e54e-4cbb-9e70-a1c5ef974862 req-f4afe442-a98c-45d0-aa59-bc437df403d1 service nova] Creating event network-vif-plugged:09dffb1b-f334-42d1-bd74-8b59ed4648c3 for instance a0105c66-6939-4b6d-b774-c1821012c1f0 on hv-cinder-80135 Sep 05 12:32:52.816536 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-314adaeb-e54e-4cbb-9e70-a1c5ef974862 req-f4afe442-a98c-45d0-aa59-bc437df403d1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034806 Sep 05 12:32:52.817468 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 271/538] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:32:53.303598 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-970f97ad-467e-4c9a-b0f1-1eb34da872b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:53.304209 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-970f97ad-467e-4c9a-b0f1-1eb34da872b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:53.311399 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-970f97ad-467e-4c9a-b0f1-1eb34da872b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:53.311910 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-970f97ad-467e-4c9a-b0f1-1eb34da872b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:53.312340 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-970f97ad-467e-4c9a-b0f1-1eb34da872b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:53.313160 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-970f97ad-467e-4c9a-b0f1-1eb34da872b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:53.313633 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-970f97ad-467e-4c9a-b0f1-1eb34da872b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:53.314130 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-970f97ad-467e-4c9a-b0f1-1eb34da872b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:53.451239 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-970f97ad-467e-4c9a-b0f1-1eb34da872b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:53.460199 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-970f97ad-467e-4c9a-b0f1-1eb34da872b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:53.461752 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-970f97ad-467e-4c9a-b0f1-1eb34da872b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:53.462947 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-970f97ad-467e-4c9a-b0f1-1eb34da872b6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.163254 Sep 05 12:32:53.463554 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 268/539] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:53 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:54.493351 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-cd2bfe64-dade-432d-b3eb-f9cf51de93a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:54.494074 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-cd2bfe64-dade-432d-b3eb-f9cf51de93a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:54.500909 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cd2bfe64-dade-432d-b3eb-f9cf51de93a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:54.501398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cd2bfe64-dade-432d-b3eb-f9cf51de93a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:54.501832 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cd2bfe64-dade-432d-b3eb-f9cf51de93a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:54.502537 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cd2bfe64-dade-432d-b3eb-f9cf51de93a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:54.502987 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cd2bfe64-dade-432d-b3eb-f9cf51de93a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:54.503404 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cd2bfe64-dade-432d-b3eb-f9cf51de93a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:54.653007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-cd2bfe64-dade-432d-b3eb-f9cf51de93a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:54.662308 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-cd2bfe64-dade-432d-b3eb-f9cf51de93a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:54.663784 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-cd2bfe64-dade-432d-b3eb-f9cf51de93a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:54.664943 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-cd2bfe64-dade-432d-b3eb-f9cf51de93a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.176784 Sep 05 12:32:54.665646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 272/540] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:54 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:55.691457 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f5ef68d8-2ea8-471a-9dfe-85a5c0d0d333 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:55.692107 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f5ef68d8-2ea8-471a-9dfe-85a5c0d0d333 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:55.698709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f5ef68d8-2ea8-471a-9dfe-85a5c0d0d333 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:55.699194 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f5ef68d8-2ea8-471a-9dfe-85a5c0d0d333 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:55.699652 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f5ef68d8-2ea8-471a-9dfe-85a5c0d0d333 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:55.700354 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f5ef68d8-2ea8-471a-9dfe-85a5c0d0d333 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:55.700809 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f5ef68d8-2ea8-471a-9dfe-85a5c0d0d333 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:55.701234 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f5ef68d8-2ea8-471a-9dfe-85a5c0d0d333 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:55.844746 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f5ef68d8-2ea8-471a-9dfe-85a5c0d0d333 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:55.854587 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f5ef68d8-2ea8-471a-9dfe-85a5c0d0d333 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:55.856153 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f5ef68d8-2ea8-471a-9dfe-85a5c0d0d333 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:55.859185 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f5ef68d8-2ea8-471a-9dfe-85a5c0d0d333 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.171523 Sep 05 12:32:55.859792 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 269/541] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:55 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:56.885139 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-cc43f2b9-3fa0-4106-a141-f49e2b24125b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:56.885869 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-cc43f2b9-3fa0-4106-a141-f49e2b24125b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:56.892565 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cc43f2b9-3fa0-4106-a141-f49e2b24125b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:56.893048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cc43f2b9-3fa0-4106-a141-f49e2b24125b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:56.893478 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cc43f2b9-3fa0-4106-a141-f49e2b24125b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:56.894179 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cc43f2b9-3fa0-4106-a141-f49e2b24125b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:56.894633 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cc43f2b9-3fa0-4106-a141-f49e2b24125b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:56.895057 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cc43f2b9-3fa0-4106-a141-f49e2b24125b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:57.031076 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-cc43f2b9-3fa0-4106-a141-f49e2b24125b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:57.039820 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-cc43f2b9-3fa0-4106-a141-f49e2b24125b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:57.042192 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-cc43f2b9-3fa0-4106-a141-f49e2b24125b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:57.043378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-cc43f2b9-3fa0-4106-a141-f49e2b24125b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.162184 Sep 05 12:32:57.043951 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 273/542] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:56 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:58.068469 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e983bb74-d009-4479-982b-750c73c3d97e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:58.069573 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e983bb74-d009-4479-982b-750c73c3d97e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:58.076304 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e983bb74-d009-4479-982b-750c73c3d97e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:58.076826 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e983bb74-d009-4479-982b-750c73c3d97e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:58.077266 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e983bb74-d009-4479-982b-750c73c3d97e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:58.077972 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e983bb74-d009-4479-982b-750c73c3d97e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:58.078435 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e983bb74-d009-4479-982b-750c73c3d97e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:58.078889 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e983bb74-d009-4479-982b-750c73c3d97e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:58.219871 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e983bb74-d009-4479-982b-750c73c3d97e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:58.228990 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e983bb74-d009-4479-982b-750c73c3d97e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:58.230602 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e983bb74-d009-4479-982b-750c73c3d97e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:58.232056 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e983bb74-d009-4479-982b-750c73c3d97e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1807 microversion: 2.20 time: 0.167288 Sep 05 12:32:58.232628 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 270/543] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:58 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:32:59.258171 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-3a7f5c4d-9daf-4bb8-b8f5-12cf5519c657 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:32:59.258780 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-3a7f5c4d-9daf-4bb8-b8f5-12cf5519c657 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:32:59.266316 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3a7f5c4d-9daf-4bb8-b8f5-12cf5519c657 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:59.266794 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3a7f5c4d-9daf-4bb8-b8f5-12cf5519c657 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:59.267309 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3a7f5c4d-9daf-4bb8-b8f5-12cf5519c657 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:59.268276 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3a7f5c4d-9daf-4bb8-b8f5-12cf5519c657 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:32:59.268806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3a7f5c4d-9daf-4bb8-b8f5-12cf5519c657 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:32:59.269370 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3a7f5c4d-9daf-4bb8-b8f5-12cf5519c657 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:32:59.400978 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-3a7f5c4d-9daf-4bb8-b8f5-12cf5519c657 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:59.409570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-3a7f5c4d-9daf-4bb8-b8f5-12cf5519c657 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:59.411014 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-3a7f5c4d-9daf-4bb8-b8f5-12cf5519c657 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:32:59.412201 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-3a7f5c4d-9daf-4bb8-b8f5-12cf5519c657 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1794 microversion: 2.20 time: 0.158013 Sep 05 12:32:59.412759 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 274/544] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:32:59 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1794 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:33:09.941217 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7e81064d-47ca-4515-8815-c487b2523147 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:09.942173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-7e81064d-47ca-4515-8815-c487b2523147 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:09.944622 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=29 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:09.945276 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=98 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:09.951043 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7e81064d-47ca-4515-8815-c487b2523147 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:09.951530 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7e81064d-47ca-4515-8815-c487b2523147 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:09.951990 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7e81064d-47ca-4515-8815-c487b2523147 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:09.952695 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7e81064d-47ca-4515-8815-c487b2523147 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:09.953142 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7e81064d-47ca-4515-8815-c487b2523147 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:09.953564 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7e81064d-47ca-4515-8815-c487b2523147 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:09.977028 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-7e81064d-47ca-4515-8815-c487b2523147 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63/ips" status: 200 len: 151 microversion: 2.1 time: 0.039677 Sep 05 12:33:09.977593 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 271/545] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Sep 5 12:33:09 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:33:09.989340 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:09.990101 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:09.996381 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-976fd536-9d34-448c-b028-26be41535b7e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2274afe0-3d30-4240-85b8-3980bb61b404"}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:33:09.998711 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-976fd536-9d34-448c-b028-26be41535b7e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:10.004915 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-976fd536-9d34-448c-b028-26be41535b7e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:10.005346 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-976fd536-9d34-448c-b028-26be41535b7e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:10.005779 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-976fd536-9d34-448c-b028-26be41535b7e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:10.006476 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-976fd536-9d34-448c-b028-26be41535b7e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:10.006934 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-976fd536-9d34-448c-b028-26be41535b7e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:10.007360 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-976fd536-9d34-448c-b028-26be41535b7e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:10.093918 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-976fd536-9d34-448c-b028-26be41535b7e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] HTTP exception thrown: Invalid volume: volume 2274afe0-3d30-4240-85b8-3980bb61b404 is already attached to instances: 0815c135-ccc0-412c-b960-1dba28e7b455 Sep 05 12:33:10.095658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-976fd536-9d34-448c-b028-26be41535b7e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Request method failure captured: Sep 05 12:33:10.095658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: POST /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63/os-volume_attachments HTTP/1.1 Sep 05 12:33:10.095658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:33:10.095658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:33:10.095658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:33:10.095658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 74 Sep 05 12:33:10.095658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:33:10.095658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:33:10.095658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:33:10.095658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:33:10.095658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFeufoItTQsL_7sLOi4KSEP2anJWuFcJFO0wxpElVaUiOIZRHfpaIO7Ki-7p9RdECrMyfb98W4yaBOl3v_K7XBLi4W-ns2FJ7XkuNLBlexiQUHW-JFKbXbPcVAg_pV0PiNN_PWY357J1AeDPeP96j3jwWObDa2p7wcvUcxOyeHOpzSuo Sep 05 12:33:10.095658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:33:10.095658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:33:10.095658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:33:10.095658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:33:10.095658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:33:10.095658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:33:10.095658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:33:10.095658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:33:10.095658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:33:10.095658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:33:10.103794 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:33:10.103794 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:33:10.103794 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:33:10.103794 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:33:10.103794 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:33:10.103794 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:33:10.103794 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:33:10.103794 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: de2273220e824339bd13d968c75df26b Sep 05 12:33:10.103794 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:33:10.103794 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Sep 05 12:33:10.103794 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {"volumeAttachment": {"volumeId": "2274afe0-3d30-4240-85b8-3980bb61b404"}} Sep 05 12:33:10.103794 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:33:10.104618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Invalid volume: volume 2274afe0-3d30-4240-85b8-3980bb61b404 is already attached to instances: 0815c135-ccc0-412c-b960-1dba28e7b455 Sep 05 12:33:10.104618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'server_id': 'fac517b0-9cbe-4a6a-8922-21166ec0de63', 'body': {'volumeAttachment': {'volumeId': '2274afe0-3d30-4240-85b8-3980bb61b404'}}} Sep 05 12:33:10.104618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:33:10.104618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:33:10.104618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 05 12:33:10.104618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 05 12:33:10.104618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 12:33:10.104618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 12:33:10.104618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 05 12:33:10.104618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 05 12:33:10.104618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 05 12:33:10.104618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 05 12:33:10.104618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 05 12:33:10.104618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 05 12:33:10.104618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2274afe0-3d30-4240-85b8-3980bb61b404 is already attached to instances: 0815c135-ccc0-412c-b960-1dba28e7b455 Sep 05 12:33:10.104618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:33:10.104618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:33:10.104618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:33:10.104618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:33:10.105818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:33:10.105818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:33:10.105818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:33:10.105818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:33:10.105818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:33:10.105818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:33:10.105818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 12:33:10.105818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:33:10.105818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 12:33:10.105818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:33:10.105818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 12:33:10.105818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:33:10.105818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 05 12:33:10.105818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 05 12:33:10.105818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2274afe0-3d30-4240-85b8-3980bb61b404 is already attached to instances: 0815c135-ccc0-412c-b960-1dba28e7b455 Sep 05 12:33:10.105818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:33:10.105818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:33:10.105818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:33:10.105818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:33:10.105818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:33:10.107016 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:33:10.107016 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:33:10.107016 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:33:10.107016 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2274afe0-3d30-4240-85b8-3980bb61b404 is already attached to instances: 0815c135-ccc0-412c-b960-1dba28e7b455 Sep 05 12:33:10.107016 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:33:10.107016 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-976fd536-9d34-448c-b028-26be41535b7e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Returning 400 to user: Invalid volume: volume 2274afe0-3d30-4240-85b8-3980bb61b404 is already attached to instances: 0815c135-ccc0-412c-b960-1dba28e7b455 {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:33:10.107016 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-976fd536-9d34-448c-b028-26be41535b7e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "POST /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110597 Sep 05 12:33:10.107016 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 275/546] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Sep 5 12:33:09 2022] POST /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 12:33:10.110800 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-cb400270-44e4-4b48-9b5d-db664a35e55e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:10.111354 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-cb400270-44e4-4b48-9b5d-db664a35e55e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:10.118175 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cb400270-44e4-4b48-9b5d-db664a35e55e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:10.118659 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cb400270-44e4-4b48-9b5d-db664a35e55e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:10.119922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cb400270-44e4-4b48-9b5d-db664a35e55e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:10.120580 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cb400270-44e4-4b48-9b5d-db664a35e55e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:10.121036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cb400270-44e4-4b48-9b5d-db664a35e55e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:10.121466 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cb400270-44e4-4b48-9b5d-db664a35e55e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:10.146452 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-cb400270-44e4-4b48-9b5d-db664a35e55e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Going to try to terminate instance {{(pid=121211) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:33:10.448128 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-cb400270-44e4-4b48-9b5d-db664a35e55e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "DELETE /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 204 len: 0 microversion: 2.1 time: 0.344381 Sep 05 12:33:10.448961 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 272/547] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:33:10 2022] DELETE /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:33:10.457662 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d54da568-43fb-4648-881b-3dd23a35f718 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:10.458263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d54da568-43fb-4648-881b-3dd23a35f718 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:10.465903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d54da568-43fb-4648-881b-3dd23a35f718 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:10.466380 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d54da568-43fb-4648-881b-3dd23a35f718 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:10.466800 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d54da568-43fb-4648-881b-3dd23a35f718 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:10.467475 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d54da568-43fb-4648-881b-3dd23a35f718 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:10.467949 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d54da568-43fb-4648-881b-3dd23a35f718 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:10.468366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d54da568-43fb-4648-881b-3dd23a35f718 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:10.596656 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d54da568-43fb-4648-881b-3dd23a35f718 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:10.604993 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d54da568-43fb-4648-881b-3dd23a35f718 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1684 microversion: 2.1 time: 0.151472 Sep 05 12:33:10.618006 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 276/548] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:10 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:11.628792 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-299c416b-91f3-4810-8163-76ab501c6384 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:11.629413 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-299c416b-91f3-4810-8163-76ab501c6384 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:11.637419 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-299c416b-91f3-4810-8163-76ab501c6384 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:11.638003 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-299c416b-91f3-4810-8163-76ab501c6384 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:11.638528 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-299c416b-91f3-4810-8163-76ab501c6384 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:11.639318 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-299c416b-91f3-4810-8163-76ab501c6384 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:11.639904 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-299c416b-91f3-4810-8163-76ab501c6384 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:11.640419 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-299c416b-91f3-4810-8163-76ab501c6384 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:11.773295 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-299c416b-91f3-4810-8163-76ab501c6384 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:11.780898 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-299c416b-91f3-4810-8163-76ab501c6384 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1684 microversion: 2.1 time: 0.156432 Sep 05 12:33:11.781455 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 273/549] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:11 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:12.538482 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4f285116-d004-40cc-bece-ced41409b152 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2294d56-f5d6-43da-b238-8fdb69187179"}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:33:12.540969 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-4f285116-d004-40cc-bece-ced41409b152 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:12.547122 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4f285116-d004-40cc-bece-ced41409b152 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:12.552364 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4f285116-d004-40cc-bece-ced41409b152 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:12.552364 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4f285116-d004-40cc-bece-ced41409b152 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:12.552364 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4f285116-d004-40cc-bece-ced41409b152 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:12.552364 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4f285116-d004-40cc-bece-ced41409b152 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:12.552740 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4f285116-d004-40cc-bece-ced41409b152 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:12.804498 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f4f2c363-c756-4371-b37b-13b6f902a3e2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:12.805195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f4f2c363-c756-4371-b37b-13b6f902a3e2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:12.812510 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f4f2c363-c756-4371-b37b-13b6f902a3e2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:12.812986 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f4f2c363-c756-4371-b37b-13b6f902a3e2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:12.813416 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f4f2c363-c756-4371-b37b-13b6f902a3e2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:12.814105 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f4f2c363-c756-4371-b37b-13b6f902a3e2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:12.814558 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f4f2c363-c756-4371-b37b-13b6f902a3e2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:12.815102 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f4f2c363-c756-4371-b37b-13b6f902a3e2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:13.018447 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f4f2c363-c756-4371-b37b-13b6f902a3e2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:13.026096 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f4f2c363-c756-4371-b37b-13b6f902a3e2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1684 microversion: 2.1 time: 0.225677 Sep 05 12:33:13.026658 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 274/550] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:12 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1684 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:33:13.274377 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-4f285116-d004-40cc-bece-ced41409b152 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "POST /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.739718 Sep 05 12:33:13.275312 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 277/551] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Sep 5 12:33:12 2022] POST /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments => generated 194 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:33:13.639943 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-8e7f70bd-d720-41c2-ab04-64533a701493 req-a2e0d51d-6da0-4bdd-ac12-6d0906c05ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fac517b0-9cbe-4a6a-8922-21166ec0de63", "name": "network-vif-deleted", "tag": "d28f89a7-e984-4c77-9cae-fe03a7c5c344"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:33:13.650715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-8e7f70bd-d720-41c2-ab04-64533a701493 req-a2e0d51d-6da0-4bdd-ac12-6d0906c05ada service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:13.652501 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-8e7f70bd-d720-41c2-ab04-64533a701493 req-a2e0d51d-6da0-4bdd-ac12-6d0906c05ada service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:13.652501 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-8e7f70bd-d720-41c2-ab04-64533a701493 req-a2e0d51d-6da0-4bdd-ac12-6d0906c05ada service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:13.668202 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-8e7f70bd-d720-41c2-ab04-64533a701493 req-a2e0d51d-6da0-4bdd-ac12-6d0906c05ada service nova] Creating event network-vif-deleted:d28f89a7-e984-4c77-9cae-fe03a7c5c344 for instance fac517b0-9cbe-4a6a-8922-21166ec0de63 on hv-cinder-80135 Sep 05 12:33:13.674013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-8e7f70bd-d720-41c2-ab04-64533a701493 req-a2e0d51d-6da0-4bdd-ac12-6d0906c05ada service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037635 Sep 05 12:33:13.674960 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 275/552] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:33:14.051226 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-913e0cdc-d57c-4014-9913-5eab786eb08a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:14.052735 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-913e0cdc-d57c-4014-9913-5eab786eb08a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:14.060104 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-913e0cdc-d57c-4014-9913-5eab786eb08a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:14.061020 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-913e0cdc-d57c-4014-9913-5eab786eb08a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:14.062121 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-913e0cdc-d57c-4014-9913-5eab786eb08a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:14.063112 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-913e0cdc-d57c-4014-9913-5eab786eb08a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:14.070142 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-913e0cdc-d57c-4014-9913-5eab786eb08a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:14.070832 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-913e0cdc-d57c-4014-9913-5eab786eb08a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:14.110011 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-913e0cdc-d57c-4014-9913-5eab786eb08a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:14.110825 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-913e0cdc-d57c-4014-9913-5eab786eb08a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:14.111119 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-913e0cdc-d57c-4014-9913-5eab786eb08a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:14.111595 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-913e0cdc-d57c-4014-9913-5eab786eb08a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lazy-loading 'fault' on Instance uuid fac517b0-9cbe-4a6a-8922-21166ec0de63 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:33:14.177085 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-913e0cdc-d57c-4014-9913-5eab786eb08a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:14.187717 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-913e0cdc-d57c-4014-9913-5eab786eb08a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 200 len: 1332 microversion: 2.1 time: 0.140774 Sep 05 12:33:14.191401 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 278/553] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:14 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 1332 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:15.211155 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e612fa63-569b-421a-bcc2-581144d51bdc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:15.211799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e612fa63-569b-421a-bcc2-581144d51bdc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:15.218992 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e612fa63-569b-421a-bcc2-581144d51bdc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:15.219476 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e612fa63-569b-421a-bcc2-581144d51bdc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:15.219929 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e612fa63-569b-421a-bcc2-581144d51bdc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:15.220608 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e612fa63-569b-421a-bcc2-581144d51bdc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:15.221061 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e612fa63-569b-421a-bcc2-581144d51bdc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:15.221481 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e612fa63-569b-421a-bcc2-581144d51bdc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:15.235925 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-e612fa63-569b-421a-bcc2-581144d51bdc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] HTTP exception thrown: Instance fac517b0-9cbe-4a6a-8922-21166ec0de63 could not be found. Sep 05 12:33:15.237552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e612fa63-569b-421a-bcc2-581144d51bdc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Request method failure captured: Sep 05 12:33:15.237552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 HTTP/1.1 Sep 05 12:33:15.237552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:33:15.237552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:33:15.237552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:33:15.237552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:33:15.237552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:33:15.237552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:33:15.237552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:33:15.237552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:33:15.237552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFeufoItTQsL_7sLOi4KSEP2anJWuFcJFO0wxpElVaUiOIZRHfpaIO7Ki-7p9RdECrMyfb98W4yaBOl3v_K7XBLi4W-ns2FJ7XkuNLBlexiQUHW-JFKbXbPcVAg_pV0PiNN_PWY357J1AeDPeP96j3jwWObDa2p7wcvUcxOyeHOpzSuo Sep 05 12:33:15.237552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:33:15.237552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:33:15.237552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:33:15.237552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:33:15.237552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:33:15.237552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:33:15.237552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:33:15.237552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:33:15.237552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:33:15.237552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:33:15.239137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:33:15.239137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:33:15.239137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:33:15.239137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:33:15.239137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:33:15.239137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:33:15.239137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:33:15.239137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: de2273220e824339bd13d968c75df26b Sep 05 12:33:15.239137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:33:15.239137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: > Sep 05 12:33:15.239137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Instance fac517b0-9cbe-4a6a-8922-21166ec0de63 could not be found. Sep 05 12:33:15.239137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': 'fac517b0-9cbe-4a6a-8922-21166ec0de63'} Sep 05 12:33:15.240057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:33:15.240057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:33:15.240057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:33:15.240057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:33:15.240057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:33:15.240057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:33:15.240057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:33:15.240057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:33:15.240057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:33:15.240057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:33:15.240057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fac517b0-9cbe-4a6a-8922-21166ec0de63 could not be found. Sep 05 12:33:15.240057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:33:15.240057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:33:15.240057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:33:15.240057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:33:15.240057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:33:15.240057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:33:15.240057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:33:15.240057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:33:15.240057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:33:15.241465 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:33:15.241465 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:33:15.241465 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:33:15.241465 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:33:15.241465 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:33:15.241465 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:33:15.241465 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:33:15.241465 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fac517b0-9cbe-4a6a-8922-21166ec0de63 could not be found. Sep 05 12:33:15.241465 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:33:15.241465 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:33:15.241465 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:33:15.241465 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:33:15.241465 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:33:15.241465 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:33:15.241465 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:33:15.241465 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:33:15.241465 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fac517b0-9cbe-4a6a-8922-21166ec0de63 could not be found. Sep 05 12:33:15.241465 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:33:15.243157 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e612fa63-569b-421a-bcc2-581144d51bdc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Returning 404 to user: Instance fac517b0-9cbe-4a6a-8922-21166ec0de63 could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:33:15.243157 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e612fa63-569b-421a-bcc2-581144d51bdc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 404 len: 111 microversion: 2.1 time: 0.032062 Sep 05 12:33:15.243157 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 276/554] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:15 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:33:15.247898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-f3737624-2c5e-4478-b80f-8eb61dc15066 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '.version_select at 0x7fe712954310>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:15.329133 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-f3737624-2c5e-4478-b80f-8eb61dc15066 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255692174" status: 202 len: 0 microversion: 2.1 time: 0.085058 Sep 05 12:33:15.330101 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 279/555] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Sep 5 12:33:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255692174 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:33:16.182080 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-133e2072-7fe5-428f-885e-9cce3817e338 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:16.182592 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-133e2072-7fe5-428f-885e-9cce3817e338 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:16.188959 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-133e2072-7fe5-428f-885e-9cce3817e338 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:16.189450 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-133e2072-7fe5-428f-885e-9cce3817e338 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:16.189881 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-133e2072-7fe5-428f-885e-9cce3817e338 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:16.190580 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-133e2072-7fe5-428f-885e-9cce3817e338 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:16.191024 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-133e2072-7fe5-428f-885e-9cce3817e338 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:16.191518 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-133e2072-7fe5-428f-885e-9cce3817e338 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:16.320511 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.objects.instance [None req-133e2072-7fe5-428f-885e-9cce3817e338 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lazy-loading 'services' on Instance uuid 0815c135-ccc0-412c-b960-1dba28e7b455 {{(pid=121211) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:33:16.534032 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-133e2072-7fe5-428f-885e-9cce3817e338 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/os-volume_attachments/2274afe0-3d30-4240-85b8-3980bb61b404" status: 202 len: 0 microversion: 2.1 time: 0.356423 Sep 05 12:33:16.534619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 277/556] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Sep 5 12:33:16 2022] DELETE /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/os-volume_attachments/2274afe0-3d30-4240-85b8-3980bb61b404 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:33:16.547586 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-2b1ebdec-ad26-4dad-a814-3d1fe3c9d966 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:16.549956 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-2b1ebdec-ad26-4dad-a814-3d1fe3c9d966 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:16.558544 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2b1ebdec-ad26-4dad-a814-3d1fe3c9d966 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:16.559065 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2b1ebdec-ad26-4dad-a814-3d1fe3c9d966 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:16.559503 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2b1ebdec-ad26-4dad-a814-3d1fe3c9d966 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:16.562536 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2b1ebdec-ad26-4dad-a814-3d1fe3c9d966 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:16.562536 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2b1ebdec-ad26-4dad-a814-3d1fe3c9d966 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:16.562536 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2b1ebdec-ad26-4dad-a814-3d1fe3c9d966 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:16.591025 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-2b1ebdec-ad26-4dad-a814-3d1fe3c9d966 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048062 Sep 05 12:33:16.593720 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 280/557] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:33:16 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:33:17.605788 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1e152285-6b3c-41be-be13-f351856bffe2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:17.608371 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1e152285-6b3c-41be-be13-f351856bffe2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:17.614953 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1e152285-6b3c-41be-be13-f351856bffe2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:17.615463 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1e152285-6b3c-41be-be13-f351856bffe2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:17.615925 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1e152285-6b3c-41be-be13-f351856bffe2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:17.616613 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1e152285-6b3c-41be-be13-f351856bffe2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:17.617061 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1e152285-6b3c-41be-be13-f351856bffe2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:17.617479 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1e152285-6b3c-41be-be13-f351856bffe2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:17.647585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1e152285-6b3c-41be-be13-f351856bffe2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046906 Sep 05 12:33:17.654585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 278/558] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:33:17 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:33:18.662266 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e2cc018c-0341-4761-828e-93d3def63ef1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:18.664367 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-e2cc018c-0341-4761-828e-93d3def63ef1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:18.670653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e2cc018c-0341-4761-828e-93d3def63ef1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:18.671132 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e2cc018c-0341-4761-828e-93d3def63ef1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:18.671579 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e2cc018c-0341-4761-828e-93d3def63ef1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:18.672273 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e2cc018c-0341-4761-828e-93d3def63ef1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:18.672721 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e2cc018c-0341-4761-828e-93d3def63ef1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:18.673137 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e2cc018c-0341-4761-828e-93d3def63ef1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:18.703444 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-e2cc018c-0341-4761-828e-93d3def63ef1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045127 Sep 05 12:33:18.704014 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 281/559] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:33:18 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:33:19.716416 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a838768f-e1dd-4292-b439-381ee76783ee tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:19.718537 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a838768f-e1dd-4292-b439-381ee76783ee tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:19.725030 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a838768f-e1dd-4292-b439-381ee76783ee tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:19.725520 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a838768f-e1dd-4292-b439-381ee76783ee tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:19.725956 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a838768f-e1dd-4292-b439-381ee76783ee tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:19.726652 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a838768f-e1dd-4292-b439-381ee76783ee tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:19.727103 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a838768f-e1dd-4292-b439-381ee76783ee tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:19.727527 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a838768f-e1dd-4292-b439-381ee76783ee tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:19.757230 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a838768f-e1dd-4292-b439-381ee76783ee tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045391 Sep 05 12:33:19.757819 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 279/560] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:33:19 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:33:20.770073 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-591baaeb-ab3c-440d-b9fb-85a30c81d07e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:20.772368 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-591baaeb-ab3c-440d-b9fb-85a30c81d07e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:20.778850 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-591baaeb-ab3c-440d-b9fb-85a30c81d07e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:20.779251 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-591baaeb-ab3c-440d-b9fb-85a30c81d07e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:20.779726 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-591baaeb-ab3c-440d-b9fb-85a30c81d07e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:20.780473 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-591baaeb-ab3c-440d-b9fb-85a30c81d07e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:20.780995 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-591baaeb-ab3c-440d-b9fb-85a30c81d07e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:20.781413 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-591baaeb-ab3c-440d-b9fb-85a30c81d07e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:20.824283 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-591baaeb-ab3c-440d-b9fb-85a30c81d07e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058002 Sep 05 12:33:20.825119 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 282/561] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:33:20 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:33:21.837118 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-24729609-8e26-4daf-864f-517bb58c665f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:21.839505 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-24729609-8e26-4daf-864f-517bb58c665f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:21.846989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-24729609-8e26-4daf-864f-517bb58c665f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:21.847485 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-24729609-8e26-4daf-864f-517bb58c665f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:21.847968 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-24729609-8e26-4daf-864f-517bb58c665f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:21.848663 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-24729609-8e26-4daf-864f-517bb58c665f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:21.849114 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-24729609-8e26-4daf-864f-517bb58c665f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:21.849538 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-24729609-8e26-4daf-864f-517bb58c665f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:21.879481 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-24729609-8e26-4daf-864f-517bb58c665f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046314 Sep 05 12:33:21.880278 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 280/562] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:33:21 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:33:21.937919 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a6b59c21-6471-4eab-a162-2c1acee05f70 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:33:21.940174 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a6b59c21-6471-4eab-a162-2c1acee05f70 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:21.946976 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a6b59c21-6471-4eab-a162-2c1acee05f70 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:21.948330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a6b59c21-6471-4eab-a162-2c1acee05f70 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:21.948542 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a6b59c21-6471-4eab-a162-2c1acee05f70 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:21.949168 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a6b59c21-6471-4eab-a162-2c1acee05f70 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:21.949615 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a6b59c21-6471-4eab-a162-2c1acee05f70 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:21.950026 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a6b59c21-6471-4eab-a162-2c1acee05f70 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:21.973304 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-a6b59c21-6471-4eab-a162-2c1acee05f70 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lazy-loading 'flavor' on Instance uuid c86e0b82-f349-40c6-986b-359cb36a9862 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:33:22.361316 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a6b59c21-6471-4eab-a162-2c1acee05f70 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "POST /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/action" status: 200 len: 32 microversion: 2.1 time: 0.427312 Sep 05 12:33:22.362168 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 283/563] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Sep 5 12:33:21 2022] POST /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/action => generated 32 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 12:33:22.371827 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e17cea9a-7a7a-41fe-8f29-77204036cab6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:22.372446 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e17cea9a-7a7a-41fe-8f29-77204036cab6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:22.378630 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e17cea9a-7a7a-41fe-8f29-77204036cab6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:22.379149 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e17cea9a-7a7a-41fe-8f29-77204036cab6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:22.379600 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e17cea9a-7a7a-41fe-8f29-77204036cab6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:22.380294 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e17cea9a-7a7a-41fe-8f29-77204036cab6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:22.380747 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e17cea9a-7a7a-41fe-8f29-77204036cab6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:22.381167 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e17cea9a-7a7a-41fe-8f29-77204036cab6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:22.522320 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e17cea9a-7a7a-41fe-8f29-77204036cab6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:22.531694 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e17cea9a-7a7a-41fe-8f29-77204036cab6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1735 microversion: 2.1 time: 0.164280 Sep 05 12:33:22.532359 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 281/564] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:22 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:22.897002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-531e7880-0d28-417a-8eca-84594a5b4fc6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:22.899470 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-531e7880-0d28-417a-8eca-84594a5b4fc6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:22.906532 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-531e7880-0d28-417a-8eca-84594a5b4fc6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:22.907036 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-531e7880-0d28-417a-8eca-84594a5b4fc6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:22.907629 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-531e7880-0d28-417a-8eca-84594a5b4fc6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:22.908528 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-531e7880-0d28-417a-8eca-84594a5b4fc6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:22.908793 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-531e7880-0d28-417a-8eca-84594a5b4fc6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:22.909216 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-531e7880-0d28-417a-8eca-84594a5b4fc6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:22.939670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-531e7880-0d28-417a-8eca-84594a5b4fc6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050847 Sep 05 12:33:22.940362 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 284/565] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:33:22 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 12:33:23.006266 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-af625e4f-ef22-4df6-8b6a-fcedf3f9a5a1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:23.006833 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-af625e4f-ef22-4df6-8b6a-fcedf3f9a5a1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:23.015296 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-af625e4f-ef22-4df6-8b6a-fcedf3f9a5a1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:23.015485 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-af625e4f-ef22-4df6-8b6a-fcedf3f9a5a1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:23.016220 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-af625e4f-ef22-4df6-8b6a-fcedf3f9a5a1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:23.016534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-af625e4f-ef22-4df6-8b6a-fcedf3f9a5a1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:23.016993 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-af625e4f-ef22-4df6-8b6a-fcedf3f9a5a1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:23.017432 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-af625e4f-ef22-4df6-8b6a-fcedf3f9a5a1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:23.043743 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-af625e4f-ef22-4df6-8b6a-fcedf3f9a5a1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Going to try to terminate instance {{(pid=121211) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:33:23.323144 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-af625e4f-ef22-4df6-8b6a-fcedf3f9a5a1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 204 len: 0 microversion: 2.1 time: 0.319520 Sep 05 12:33:23.324008 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 282/566] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:33:23 2022] DELETE /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:33:23.334212 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-394f60b5-e112-40e3-b491-07bb08bb890d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:23.335071 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-394f60b5-e112-40e3-b491-07bb08bb890d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:23.342347 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-394f60b5-e112-40e3-b491-07bb08bb890d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:23.342829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-394f60b5-e112-40e3-b491-07bb08bb890d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:23.343253 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-394f60b5-e112-40e3-b491-07bb08bb890d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:23.344237 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-394f60b5-e112-40e3-b491-07bb08bb890d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:23.344717 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-394f60b5-e112-40e3-b491-07bb08bb890d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:23.345135 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-394f60b5-e112-40e3-b491-07bb08bb890d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:23.480723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-394f60b5-e112-40e3-b491-07bb08bb890d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:23.488729 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-394f60b5-e112-40e3-b491-07bb08bb890d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1681 microversion: 2.1 time: 0.159502 Sep 05 12:33:23.489299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 285/567] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:23 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:23.556368 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3b412839-1f81-40ee-b0f1-229870e50216 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:23.557907 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-3b412839-1f81-40ee-b0f1-229870e50216 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:23.563805 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3b412839-1f81-40ee-b0f1-229870e50216 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:23.564286 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3b412839-1f81-40ee-b0f1-229870e50216 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:23.564716 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3b412839-1f81-40ee-b0f1-229870e50216 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:23.565399 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3b412839-1f81-40ee-b0f1-229870e50216 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:23.565867 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3b412839-1f81-40ee-b0f1-229870e50216 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:23.566475 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3b412839-1f81-40ee-b0f1-229870e50216 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:23.697634 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3b412839-1f81-40ee-b0f1-229870e50216 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:23.705876 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3b412839-1f81-40ee-b0f1-229870e50216 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1735 microversion: 2.1 time: 0.153611 Sep 05 12:33:23.706433 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 283/568] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:23 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:24.513590 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7e40391d-1def-4687-8445-32751714c265 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:24.514197 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-7e40391d-1def-4687-8445-32751714c265 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:24.520814 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7e40391d-1def-4687-8445-32751714c265 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:24.521294 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7e40391d-1def-4687-8445-32751714c265 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:24.525405 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7e40391d-1def-4687-8445-32751714c265 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:24.525405 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7e40391d-1def-4687-8445-32751714c265 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:24.525405 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7e40391d-1def-4687-8445-32751714c265 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:24.525405 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7e40391d-1def-4687-8445-32751714c265 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:24.655021 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-7e40391d-1def-4687-8445-32751714c265 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:24.663737 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-7e40391d-1def-4687-8445-32751714c265 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1681 microversion: 2.1 time: 0.154461 Sep 05 12:33:24.664328 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 286/569] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:24 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:24.728984 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0e8453dd-52f5-42e8-b80f-2980eddf2851 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:24.729596 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0e8453dd-52f5-42e8-b80f-2980eddf2851 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:24.736638 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e8453dd-52f5-42e8-b80f-2980eddf2851 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:24.737141 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e8453dd-52f5-42e8-b80f-2980eddf2851 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:24.737572 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e8453dd-52f5-42e8-b80f-2980eddf2851 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:24.738253 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e8453dd-52f5-42e8-b80f-2980eddf2851 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:24.738704 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e8453dd-52f5-42e8-b80f-2980eddf2851 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:24.739125 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e8453dd-52f5-42e8-b80f-2980eddf2851 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:24.870540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0e8453dd-52f5-42e8-b80f-2980eddf2851 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:24.879471 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0e8453dd-52f5-42e8-b80f-2980eddf2851 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1735 microversion: 2.1 time: 0.154263 Sep 05 12:33:24.880096 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 284/570] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:24 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:25.686659 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-889fc57e-9deb-4f7b-808b-cfc755a953c0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:25.687392 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-889fc57e-9deb-4f7b-808b-cfc755a953c0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:25.694245 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-889fc57e-9deb-4f7b-808b-cfc755a953c0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:25.695013 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-889fc57e-9deb-4f7b-808b-cfc755a953c0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:25.695185 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-889fc57e-9deb-4f7b-808b-cfc755a953c0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:25.695914 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-889fc57e-9deb-4f7b-808b-cfc755a953c0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:25.696368 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-889fc57e-9deb-4f7b-808b-cfc755a953c0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:25.696786 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-889fc57e-9deb-4f7b-808b-cfc755a953c0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:25.830213 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-889fc57e-9deb-4f7b-808b-cfc755a953c0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:25.838776 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-889fc57e-9deb-4f7b-808b-cfc755a953c0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1681 microversion: 2.1 time: 0.155694 Sep 05 12:33:25.839404 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 287/571] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:25 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:25.904430 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4ced8dc0-1a38-4495-bf8c-cbe439bef0ef tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:25.905036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4ced8dc0-1a38-4495-bf8c-cbe439bef0ef tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:25.911351 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ced8dc0-1a38-4495-bf8c-cbe439bef0ef tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:25.911853 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ced8dc0-1a38-4495-bf8c-cbe439bef0ef tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:25.912283 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ced8dc0-1a38-4495-bf8c-cbe439bef0ef tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:25.913115 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ced8dc0-1a38-4495-bf8c-cbe439bef0ef tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:25.913567 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ced8dc0-1a38-4495-bf8c-cbe439bef0ef tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:25.913988 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ced8dc0-1a38-4495-bf8c-cbe439bef0ef tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:25.929339 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:26.108896 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-4ced8dc0-1a38-4495-bf8c-cbe439bef0ef tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:26.117620 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4ced8dc0-1a38-4495-bf8c-cbe439bef0ef tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1735 microversion: 2.1 time: 0.217920 Sep 05 12:33:26.122948 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 285/572] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:25 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:26.530910 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-08e17dd2-9d91-4d1b-86d2-c7d77e024dfb req-66c4a76b-7a53-42f9-93e8-531bbdad3e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0815c135-ccc0-412c-b960-1dba28e7b455", "name": "network-vif-deleted", "tag": "b48abd9f-ccdb-4cd2-a0d6-bc38fac6b27f"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:33:26.541522 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-08e17dd2-9d91-4d1b-86d2-c7d77e024dfb req-66c4a76b-7a53-42f9-93e8-531bbdad3e22 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:26.541998 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-08e17dd2-9d91-4d1b-86d2-c7d77e024dfb req-66c4a76b-7a53-42f9-93e8-531bbdad3e22 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:26.542423 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-08e17dd2-9d91-4d1b-86d2-c7d77e024dfb req-66c4a76b-7a53-42f9-93e8-531bbdad3e22 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:26.553659 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-08e17dd2-9d91-4d1b-86d2-c7d77e024dfb req-66c4a76b-7a53-42f9-93e8-531bbdad3e22 service nova] Creating event network-vif-deleted:b48abd9f-ccdb-4cd2-a0d6-bc38fac6b27f for instance 0815c135-ccc0-412c-b960-1dba28e7b455 on hv-cinder-80135 Sep 05 12:33:26.559394 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-08e17dd2-9d91-4d1b-86d2-c7d77e024dfb req-66c4a76b-7a53-42f9-93e8-531bbdad3e22 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032131 Sep 05 12:33:26.562975 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 288/573] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:33:26.864368 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-79a795ac-39d6-458f-a48e-d3d2d8720c73 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:26.864984 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-79a795ac-39d6-458f-a48e-d3d2d8720c73 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:26.872264 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-79a795ac-39d6-458f-a48e-d3d2d8720c73 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:26.872823 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-79a795ac-39d6-458f-a48e-d3d2d8720c73 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:26.873442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-79a795ac-39d6-458f-a48e-d3d2d8720c73 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:26.874140 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-79a795ac-39d6-458f-a48e-d3d2d8720c73 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:26.874592 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-79a795ac-39d6-458f-a48e-d3d2d8720c73 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:26.875020 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-79a795ac-39d6-458f-a48e-d3d2d8720c73 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:26.921681 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-79a795ac-39d6-458f-a48e-d3d2d8720c73 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:26.922371 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-79a795ac-39d6-458f-a48e-d3d2d8720c73 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:26.922559 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-79a795ac-39d6-458f-a48e-d3d2d8720c73 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:26.923016 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.objects.instance [None req-79a795ac-39d6-458f-a48e-d3d2d8720c73 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lazy-loading 'fault' on Instance uuid 0815c135-ccc0-412c-b960-1dba28e7b455 {{(pid=121211) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:33:26.965626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-79a795ac-39d6-458f-a48e-d3d2d8720c73 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:26.973587 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-79a795ac-39d6-458f-a48e-d3d2d8720c73 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 200 len: 1331 microversion: 2.1 time: 0.113217 Sep 05 12:33:26.974157 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 286/574] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:26 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:27.148166 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a93b5e50-2a3e-45e8-91de-69bcdd25f489 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:27.148887 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a93b5e50-2a3e-45e8-91de-69bcdd25f489 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:27.156125 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a93b5e50-2a3e-45e8-91de-69bcdd25f489 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:27.156620 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a93b5e50-2a3e-45e8-91de-69bcdd25f489 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:27.157052 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a93b5e50-2a3e-45e8-91de-69bcdd25f489 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:27.157774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a93b5e50-2a3e-45e8-91de-69bcdd25f489 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:27.158228 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a93b5e50-2a3e-45e8-91de-69bcdd25f489 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:27.158652 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a93b5e50-2a3e-45e8-91de-69bcdd25f489 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:27.179733 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:27.307614 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a93b5e50-2a3e-45e8-91de-69bcdd25f489 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:27.316235 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a93b5e50-2a3e-45e8-91de-69bcdd25f489 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1735 microversion: 2.1 time: 0.172658 Sep 05 12:33:27.316911 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 289/575] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:27 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:33:27.997995 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-83dceef1-30e1-4a73-a5a4-a45da0aec1e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:27.998537 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-83dceef1-30e1-4a73-a5a4-a45da0aec1e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:28.004897 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-83dceef1-30e1-4a73-a5a4-a45da0aec1e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:28.005426 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-83dceef1-30e1-4a73-a5a4-a45da0aec1e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:28.005812 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-83dceef1-30e1-4a73-a5a4-a45da0aec1e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:28.006503 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-83dceef1-30e1-4a73-a5a4-a45da0aec1e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:28.006958 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-83dceef1-30e1-4a73-a5a4-a45da0aec1e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:28.007387 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-83dceef1-30e1-4a73-a5a4-a45da0aec1e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:28.020473 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-83dceef1-30e1-4a73-a5a4-a45da0aec1e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] HTTP exception thrown: Instance 0815c135-ccc0-412c-b960-1dba28e7b455 could not be found. Sep 05 12:33:28.022181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-83dceef1-30e1-4a73-a5a4-a45da0aec1e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Request method failure captured: Sep 05 12:33:28.022181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 HTTP/1.1 Sep 05 12:33:28.022181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:33:28.022181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:33:28.022181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:33:28.022181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:33:28.022181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:33:28.022181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:33:28.022181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:33:28.022181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:33:28.022181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFeufoItTQsL_7sLOi4KSEP2anJWuFcJFO0wxpElVaUiOIZRHfpaIO7Ki-7p9RdECrMyfb98W4yaBOl3v_K7XBLi4W-ns2FJ7XkuNLBlexiQUHW-JFKbXbPcVAg_pV0PiNN_PWY357J1AeDPeP96j3jwWObDa2p7wcvUcxOyeHOpzSuo Sep 05 12:33:28.022181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:33:28.022181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:33:28.022181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:33:28.022181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:33:28.022181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:33:28.022181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:33:28.022181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:33:28.022181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:33:28.022181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:33:28.022181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:33:28.028158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:33:28.028158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:33:28.028158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:33:28.028158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:33:28.028158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:33:28.028158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:33:28.028158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:33:28.028158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: de2273220e824339bd13d968c75df26b Sep 05 12:33:28.028158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:33:28.028158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: > Sep 05 12:33:28.028158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Instance 0815c135-ccc0-412c-b960-1dba28e7b455 could not be found. Sep 05 12:33:28.028158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': '0815c135-ccc0-412c-b960-1dba28e7b455'} Sep 05 12:33:28.029248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:33:28.029248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:33:28.029248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:33:28.029248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:33:28.029248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:33:28.029248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:33:28.029248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:33:28.029248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:33:28.029248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:33:28.029248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:33:28.029248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0815c135-ccc0-412c-b960-1dba28e7b455 could not be found. Sep 05 12:33:28.029248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:33:28.029248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:33:28.029248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:33:28.029248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:33:28.029248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:33:28.029248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:33:28.029248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:33:28.029248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:33:28.029248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:33:28.030709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:33:28.030709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:33:28.030709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:33:28.030709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:33:28.030709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:33:28.030709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:33:28.030709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:33:28.030709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0815c135-ccc0-412c-b960-1dba28e7b455 could not be found. Sep 05 12:33:28.030709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:33:28.030709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:33:28.030709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:33:28.030709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:33:28.030709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:33:28.030709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:33:28.030709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:33:28.030709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:33:28.030709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0815c135-ccc0-412c-b960-1dba28e7b455 could not be found. Sep 05 12:33:28.030709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:33:28.031986 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-83dceef1-30e1-4a73-a5a4-a45da0aec1e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Returning 404 to user: Instance 0815c135-ccc0-412c-b960-1dba28e7b455 could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:33:28.031986 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-83dceef1-30e1-4a73-a5a4-a45da0aec1e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 404 len: 111 microversion: 2.1 time: 0.030087 Sep 05 12:33:28.031986 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 287/576] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:27 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:33:28.033961 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-047b730a-31b8-4b1f-9606-3d1c5b58aa07 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '.version_select at 0x7fe7128d1e50>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:28.089055 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-047b730a-31b8-4b1f-9606-3d1c5b58aa07 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1075329398" status: 202 len: 0 microversion: 2.1 time: 0.059045 Sep 05 12:33:28.089643 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 290/577] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Sep 5 12:33:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1075329398 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:33:28.339686 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f18a8553-bc5d-4625-8e50-d6fe5f3c0619 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:28.340306 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f18a8553-bc5d-4625-8e50-d6fe5f3c0619 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:28.346763 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f18a8553-bc5d-4625-8e50-d6fe5f3c0619 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:28.347248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f18a8553-bc5d-4625-8e50-d6fe5f3c0619 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:28.347720 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f18a8553-bc5d-4625-8e50-d6fe5f3c0619 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:28.348447 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f18a8553-bc5d-4625-8e50-d6fe5f3c0619 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:28.348901 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f18a8553-bc5d-4625-8e50-d6fe5f3c0619 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:28.349332 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f18a8553-bc5d-4625-8e50-d6fe5f3c0619 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:28.586361 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f18a8553-bc5d-4625-8e50-d6fe5f3c0619 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:28.595069 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f18a8553-bc5d-4625-8e50-d6fe5f3c0619 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1735 microversion: 2.1 time: 0.259390 Sep 05 12:33:28.595671 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 288/578] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:28 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1735 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:28.921881 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-0d030900-a9c5-4114-a0cc-ba13ee5c656a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Action: 'create', calling method: .version_select at 0x7fe7128cab80>, body: {"keypair": {"name": "tempest-keypair-1864735406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPv+AK47ZhOWLqsbWU6ZllpKwtrLTUDbfG5Pm2SxeeGm4Hp3lfSihPWKPGEGxfvPhr5B4zN4NksiUeL1XtJWi1XUJ5xGsnWag6kLM5qDGCViO9oFdZQAkiDljAybYbnSA=="}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:33:28.938189 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-0d030900-a9c5-4114-a0cc-ba13ee5c656a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Getting quotas for project 4f6830d2e75a47c8a757d4a66c6695ca. Resources: {'key_pairs'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:33:28.942173 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-0d030900-a9c5-4114-a0cc-ba13ee5c656a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Getting quotas for user de2273220e824339bd13d968c75df26b and project 4f6830d2e75a47c8a757d4a66c6695ca. Resources: {'key_pairs'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:33:29.052354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-0d030900-a9c5-4114-a0cc-ba13ee5c656a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134829 Sep 05 12:33:29.053784 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 291/579] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Sep 5 12:33:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:33:29.619704 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-5e5d3208-dc97-41cf-ba6d-e05ccbe7b0cb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:29.620951 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-5e5d3208-dc97-41cf-ba6d-e05ccbe7b0cb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:29.627329 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5e5d3208-dc97-41cf-ba6d-e05ccbe7b0cb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:29.627847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5e5d3208-dc97-41cf-ba6d-e05ccbe7b0cb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:29.628286 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5e5d3208-dc97-41cf-ba6d-e05ccbe7b0cb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:29.628973 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5e5d3208-dc97-41cf-ba6d-e05ccbe7b0cb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:29.629428 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5e5d3208-dc97-41cf-ba6d-e05ccbe7b0cb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:29.629856 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5e5d3208-dc97-41cf-ba6d-e05ccbe7b0cb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:29.808681 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5e5d3208-dc97-41cf-ba6d-e05ccbe7b0cb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:29.817303 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-5e5d3208-dc97-41cf-ba6d-e05ccbe7b0cb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1735 microversion: 2.1 time: 0.201696 Sep 05 12:33:29.818082 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 289/580] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:29 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:30.842591 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-657359a0-8c1b-4a47-b40c-9647f779dbc6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:30.843196 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-657359a0-8c1b-4a47-b40c-9647f779dbc6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:30.849638 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-657359a0-8c1b-4a47-b40c-9647f779dbc6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:30.850122 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-657359a0-8c1b-4a47-b40c-9647f779dbc6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:30.850549 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-657359a0-8c1b-4a47-b40c-9647f779dbc6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:30.851252 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-657359a0-8c1b-4a47-b40c-9647f779dbc6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:30.851878 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-657359a0-8c1b-4a47-b40c-9647f779dbc6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:30.852319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-657359a0-8c1b-4a47-b40c-9647f779dbc6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:31.002581 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-657359a0-8c1b-4a47-b40c-9647f779dbc6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:31.011114 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-657359a0-8c1b-4a47-b40c-9647f779dbc6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1735 microversion: 2.1 time: 0.172948 Sep 05 12:33:31.011963 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 292/581] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:30 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:31.306819 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-96815de6-e330-4dc0-9adc-f9a7328fe517 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-590973120", "imageRef": "7844cf5b-4975-4cb9-a7f8-31cc5e52098a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7678039b-6ecf-4526-a1ee-cbdc20c4b02b"}], "security_groups": [{"name": "tempest-securitygroup--2032421573"}], "key_name": "tempest-keypair-1864735406", "user_data": "}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:33:31.415491 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.network.neutron [None req-96815de6-e330-4dc0-9adc-f9a7328fe517 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] validate_networks() for [('7678039b-6ecf-4526-a1ee-cbdc20c4b02b', None, None, None, None, None)] {{(pid=121211) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:33:31.798570 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-96815de6-e330-4dc0-9adc-f9a7328fe517 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Flavor limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:33:31.799062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-96815de6-e330-4dc0-9adc-f9a7328fe517 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Image limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:33:31.799529 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-96815de6-e330-4dc0-9adc-f9a7328fe517 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Flavor pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:33:31.799954 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-96815de6-e330-4dc0-9adc-f9a7328fe517 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Image pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:33:31.800362 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-96815de6-e330-4dc0-9adc-f9a7328fe517 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:33:31.810917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-96815de6-e330-4dc0-9adc-f9a7328fe517 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:31.811392 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-96815de6-e330-4dc0-9adc-f9a7328fe517 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:31.811822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-96815de6-e330-4dc0-9adc-f9a7328fe517 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:31.812643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-96815de6-e330-4dc0-9adc-f9a7328fe517 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:31.813086 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-96815de6-e330-4dc0-9adc-f9a7328fe517 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:31.813504 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-96815de6-e330-4dc0-9adc-f9a7328fe517 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:31.829918 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-96815de6-e330-4dc0-9adc-f9a7328fe517 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Getting quotas for project 4f6830d2e75a47c8a757d4a66c6695ca. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:33:31.833810 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-96815de6-e330-4dc0-9adc-f9a7328fe517 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Getting quotas for user de2273220e824339bd13d968c75df26b and project 4f6830d2e75a47c8a757d4a66c6695ca. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:33:31.844623 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-96815de6-e330-4dc0-9adc-f9a7328fe517 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Going to run 1 instances... {{(pid=121211) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:33:31.846968 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-96815de6-e330-4dc0-9adc-f9a7328fe517 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7844cf5b-4975-4cb9-a7f8-31cc5e52098a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121211) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:33:31.988040 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-96815de6-e330-4dc0-9adc-f9a7328fe517 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.685595 Sep 05 12:33:31.988682 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 290/582] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Sep 5 12:33:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:33:32.000892 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-af55880d-93a5-4d81-9071-432b748960e6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:32.001736 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-af55880d-93a5-4d81-9071-432b748960e6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:32.034118 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4fabe2e5-126f-41a8-b06b-82c05c1c700d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:32.034830 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4fabe2e5-126f-41a8-b06b-82c05c1c700d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:32.041635 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4fabe2e5-126f-41a8-b06b-82c05c1c700d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:32.043024 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4fabe2e5-126f-41a8-b06b-82c05c1c700d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:32.043741 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4fabe2e5-126f-41a8-b06b-82c05c1c700d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:32.044560 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4fabe2e5-126f-41a8-b06b-82c05c1c700d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:32.045233 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4fabe2e5-126f-41a8-b06b-82c05c1c700d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:32.053068 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4fabe2e5-126f-41a8-b06b-82c05c1c700d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:32.067329 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-af55880d-93a5-4d81-9071-432b748960e6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:32.074280 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-af55880d-93a5-4d81-9071-432b748960e6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 200 len: 1241 microversion: 2.1 time: 0.077817 Sep 05 12:33:32.075058 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 293/583] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:31 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:32.207737 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-4fabe2e5-126f-41a8-b06b-82c05c1c700d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:32.216038 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4fabe2e5-126f-41a8-b06b-82c05c1c700d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1735 microversion: 2.1 time: 0.185856 Sep 05 12:33:32.216622 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 291/584] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:32 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:33:33.098323 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a59dc36d-6f7d-444d-89ab-1dcd3882d9bc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:33.098945 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a59dc36d-6f7d-444d-89ab-1dcd3882d9bc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:33.107250 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a59dc36d-6f7d-444d-89ab-1dcd3882d9bc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:33.107774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a59dc36d-6f7d-444d-89ab-1dcd3882d9bc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:33.108266 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a59dc36d-6f7d-444d-89ab-1dcd3882d9bc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:33.109230 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a59dc36d-6f7d-444d-89ab-1dcd3882d9bc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:33.109685 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a59dc36d-6f7d-444d-89ab-1dcd3882d9bc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:33.110110 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a59dc36d-6f7d-444d-89ab-1dcd3882d9bc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:33.177907 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a59dc36d-6f7d-444d-89ab-1dcd3882d9bc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:33.185802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a59dc36d-6f7d-444d-89ab-1dcd3882d9bc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 200 len: 1245 microversion: 2.1 time: 0.091326 Sep 05 12:33:33.186375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 294/585] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:33 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:33.238907 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-6c4351b4-b26d-4c67-ade5-8c6261d2624a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:33.239698 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-6c4351b4-b26d-4c67-ade5-8c6261d2624a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:33.246072 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c4351b4-b26d-4c67-ade5-8c6261d2624a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:33.246558 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c4351b4-b26d-4c67-ade5-8c6261d2624a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:33.246991 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c4351b4-b26d-4c67-ade5-8c6261d2624a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:33.247718 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c4351b4-b26d-4c67-ade5-8c6261d2624a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:33.248170 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c4351b4-b26d-4c67-ade5-8c6261d2624a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:33.248596 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c4351b4-b26d-4c67-ade5-8c6261d2624a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:33.380216 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6c4351b4-b26d-4c67-ade5-8c6261d2624a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:33.389460 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-6c4351b4-b26d-4c67-ade5-8c6261d2624a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1735 microversion: 2.1 time: 0.154407 Sep 05 12:33:33.390125 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 292/586] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:33 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:34.209174 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-b08e4cba-0c40-416d-9853-2ad30e584f2e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:34.209782 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-b08e4cba-0c40-416d-9853-2ad30e584f2e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:34.217118 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b08e4cba-0c40-416d-9853-2ad30e584f2e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:34.218637 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b08e4cba-0c40-416d-9853-2ad30e584f2e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:34.218637 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b08e4cba-0c40-416d-9853-2ad30e584f2e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:34.219290 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b08e4cba-0c40-416d-9853-2ad30e584f2e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:34.219882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b08e4cba-0c40-416d-9853-2ad30e584f2e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:34.220440 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b08e4cba-0c40-416d-9853-2ad30e584f2e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:34.290328 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-b08e4cba-0c40-416d-9853-2ad30e584f2e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:34.298076 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-b08e4cba-0c40-416d-9853-2ad30e584f2e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 200 len: 1293 microversion: 2.1 time: 0.092814 Sep 05 12:33:34.298648 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 295/587] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:34 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:34.414850 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7c1bb4c9-0013-4c01-a2bc-d23d62d58707 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:34.415580 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-7c1bb4c9-0013-4c01-a2bc-d23d62d58707 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:34.423016 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7c1bb4c9-0013-4c01-a2bc-d23d62d58707 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:34.423672 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7c1bb4c9-0013-4c01-a2bc-d23d62d58707 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:34.424159 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7c1bb4c9-0013-4c01-a2bc-d23d62d58707 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:34.424866 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7c1bb4c9-0013-4c01-a2bc-d23d62d58707 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:34.425324 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7c1bb4c9-0013-4c01-a2bc-d23d62d58707 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:34.425749 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7c1bb4c9-0013-4c01-a2bc-d23d62d58707 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:34.891660 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-7c1bb4c9-0013-4c01-a2bc-d23d62d58707 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:34.901924 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-7c1bb4c9-0013-4c01-a2bc-d23d62d58707 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1735 microversion: 2.1 time: 0.491233 Sep 05 12:33:34.902512 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 293/588] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:34 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1735 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:35.321322 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-112e8a26-5573-478e-9edb-a5c44f4e0378 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:35.321956 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-112e8a26-5573-478e-9edb-a5c44f4e0378 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:35.330485 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-112e8a26-5573-478e-9edb-a5c44f4e0378 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:35.332345 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-112e8a26-5573-478e-9edb-a5c44f4e0378 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:35.332345 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-112e8a26-5573-478e-9edb-a5c44f4e0378 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:35.332345 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-112e8a26-5573-478e-9edb-a5c44f4e0378 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:35.332670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-112e8a26-5573-478e-9edb-a5c44f4e0378 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:35.332970 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-112e8a26-5573-478e-9edb-a5c44f4e0378 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:35.480914 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-112e8a26-5573-478e-9edb-a5c44f4e0378 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:35.490031 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-112e8a26-5573-478e-9edb-a5c44f4e0378 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 200 len: 1367 microversion: 2.1 time: 0.172534 Sep 05 12:33:35.491171 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 296/589] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:35 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:35.925183 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0c02d614-763d-4516-857c-3bc84ad0e238 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:35.925878 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0c02d614-763d-4516-857c-3bc84ad0e238 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:35.932258 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c02d614-763d-4516-857c-3bc84ad0e238 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:35.943582 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c02d614-763d-4516-857c-3bc84ad0e238 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:35.943582 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c02d614-763d-4516-857c-3bc84ad0e238 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:35.943582 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c02d614-763d-4516-857c-3bc84ad0e238 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:35.943582 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c02d614-763d-4516-857c-3bc84ad0e238 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:35.944144 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c02d614-763d-4516-857c-3bc84ad0e238 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:36.160600 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0c02d614-763d-4516-857c-3bc84ad0e238 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:36.173768 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0c02d614-763d-4516-857c-3bc84ad0e238 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1735 microversion: 2.1 time: 0.252318 Sep 05 12:33:36.175989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 294/590] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:35 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1735 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:36.437167 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-af8d4336-29f9-47f7-98da-e22097e2ca73 req-87151e0b-787d-46e7-83ba-7b12e8ea7568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d85243e-7c92-4640-8c2d-72c79cf18d76", "tag": "b6f5eb31-8603-45c5-8275-77ad7a36982d"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:33:36.447670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-af8d4336-29f9-47f7-98da-e22097e2ca73 req-87151e0b-787d-46e7-83ba-7b12e8ea7568 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:36.448311 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-af8d4336-29f9-47f7-98da-e22097e2ca73 req-87151e0b-787d-46e7-83ba-7b12e8ea7568 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:36.448749 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-af8d4336-29f9-47f7-98da-e22097e2ca73 req-87151e0b-787d-46e7-83ba-7b12e8ea7568 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:36.459722 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-af8d4336-29f9-47f7-98da-e22097e2ca73 req-87151e0b-787d-46e7-83ba-7b12e8ea7568 service nova] Creating event network-changed:b6f5eb31-8603-45c5-8275-77ad7a36982d for instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 on hv-cinder-80135 Sep 05 12:33:36.464706 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-af8d4336-29f9-47f7-98da-e22097e2ca73 req-87151e0b-787d-46e7-83ba-7b12e8ea7568 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031802 Sep 05 12:33:36.465320 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 297/591] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:33:36.514290 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8093946e-b359-4f1e-931e-b354cc5e34e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:36.514908 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-8093946e-b359-4f1e-931e-b354cc5e34e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:36.521033 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8093946e-b359-4f1e-931e-b354cc5e34e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:36.521548 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8093946e-b359-4f1e-931e-b354cc5e34e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:36.521987 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8093946e-b359-4f1e-931e-b354cc5e34e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:36.522690 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8093946e-b359-4f1e-931e-b354cc5e34e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:36.523148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8093946e-b359-4f1e-931e-b354cc5e34e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:36.523606 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8093946e-b359-4f1e-931e-b354cc5e34e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:36.654069 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-8093946e-b359-4f1e-931e-b354cc5e34e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:36.662110 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-8093946e-b359-4f1e-931e-b354cc5e34e0 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 200 len: 1367 microversion: 2.1 time: 0.151682 Sep 05 12:33:36.675912 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 295/592] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:36 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:37.197972 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d075b7c3-762c-4d89-a000-a60e3292067c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:37.199408 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d075b7c3-762c-4d89-a000-a60e3292067c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:37.205526 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d075b7c3-762c-4d89-a000-a60e3292067c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:37.206004 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d075b7c3-762c-4d89-a000-a60e3292067c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:37.206430 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d075b7c3-762c-4d89-a000-a60e3292067c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:37.207120 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d075b7c3-762c-4d89-a000-a60e3292067c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:37.207596 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d075b7c3-762c-4d89-a000-a60e3292067c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:37.208021 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d075b7c3-762c-4d89-a000-a60e3292067c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:37.359201 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d075b7c3-762c-4d89-a000-a60e3292067c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:37.367621 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d075b7c3-762c-4d89-a000-a60e3292067c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1735 microversion: 2.1 time: 0.173790 Sep 05 12:33:37.369639 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 298/593] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:37 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:37.686000 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ad8ce97c-e5cd-451a-8b03-d76c6c2a08d6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:37.686600 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ad8ce97c-e5cd-451a-8b03-d76c6c2a08d6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:37.693151 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ad8ce97c-e5cd-451a-8b03-d76c6c2a08d6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:37.693623 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ad8ce97c-e5cd-451a-8b03-d76c6c2a08d6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:37.694051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ad8ce97c-e5cd-451a-8b03-d76c6c2a08d6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:37.694728 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ad8ce97c-e5cd-451a-8b03-d76c6c2a08d6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:37.695173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ad8ce97c-e5cd-451a-8b03-d76c6c2a08d6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:37.695622 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ad8ce97c-e5cd-451a-8b03-d76c6c2a08d6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:37.829667 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ad8ce97c-e5cd-451a-8b03-d76c6c2a08d6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:37.837200 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ad8ce97c-e5cd-451a-8b03-d76c6c2a08d6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 200 len: 1367 microversion: 2.1 time: 0.155583 Sep 05 12:33:37.837757 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 296/594] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:37 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:38.391413 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-0eec9e58-b149-43a4-835d-0d935c637daf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:38.392158 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-0eec9e58-b149-43a4-835d-0d935c637daf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:38.398554 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0eec9e58-b149-43a4-835d-0d935c637daf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:38.399033 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0eec9e58-b149-43a4-835d-0d935c637daf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:38.399462 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0eec9e58-b149-43a4-835d-0d935c637daf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:38.400175 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0eec9e58-b149-43a4-835d-0d935c637daf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:38.400627 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0eec9e58-b149-43a4-835d-0d935c637daf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:38.401046 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0eec9e58-b149-43a4-835d-0d935c637daf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:38.529982 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-0eec9e58-b149-43a4-835d-0d935c637daf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:38.538329 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-0eec9e58-b149-43a4-835d-0d935c637daf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1735 microversion: 2.1 time: 0.150742 Sep 05 12:33:38.538830 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 299/595] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:38 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:38.860175 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4a1bdf99-ac44-4c35-83a0-39c597aeb9af tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:38.860728 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4a1bdf99-ac44-4c35-83a0-39c597aeb9af tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:38.867200 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a1bdf99-ac44-4c35-83a0-39c597aeb9af tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:38.867734 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a1bdf99-ac44-4c35-83a0-39c597aeb9af tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:38.868173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a1bdf99-ac44-4c35-83a0-39c597aeb9af tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:38.868898 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a1bdf99-ac44-4c35-83a0-39c597aeb9af tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:38.869356 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a1bdf99-ac44-4c35-83a0-39c597aeb9af tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:38.869782 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a1bdf99-ac44-4c35-83a0-39c597aeb9af tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:39.001528 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-4a1bdf99-ac44-4c35-83a0-39c597aeb9af tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:39.009670 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4a1bdf99-ac44-4c35-83a0-39c597aeb9af tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 200 len: 1367 microversion: 2.1 time: 0.153800 Sep 05 12:33:39.010249 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 297/596] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:38 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:39.562127 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-6e99504b-5d36-45d9-b232-8c9f5d93232a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:39.562748 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-6e99504b-5d36-45d9-b232-8c9f5d93232a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:39.569333 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6e99504b-5d36-45d9-b232-8c9f5d93232a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:39.569817 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6e99504b-5d36-45d9-b232-8c9f5d93232a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:39.570248 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6e99504b-5d36-45d9-b232-8c9f5d93232a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:39.570950 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6e99504b-5d36-45d9-b232-8c9f5d93232a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:39.571404 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6e99504b-5d36-45d9-b232-8c9f5d93232a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:39.571847 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6e99504b-5d36-45d9-b232-8c9f5d93232a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:39.708814 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6e99504b-5d36-45d9-b232-8c9f5d93232a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:39.717344 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-6e99504b-5d36-45d9-b232-8c9f5d93232a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1735 microversion: 2.1 time: 0.159689 Sep 05 12:33:39.717917 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 300/597] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:39 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:40.039303 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7da62eba-c873-47ab-99d0-8f46143a35e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:40.039986 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-7da62eba-c873-47ab-99d0-8f46143a35e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:40.047199 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7da62eba-c873-47ab-99d0-8f46143a35e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:40.047722 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7da62eba-c873-47ab-99d0-8f46143a35e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:40.048165 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7da62eba-c873-47ab-99d0-8f46143a35e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:40.048874 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7da62eba-c873-47ab-99d0-8f46143a35e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:40.049330 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7da62eba-c873-47ab-99d0-8f46143a35e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:40.049754 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7da62eba-c873-47ab-99d0-8f46143a35e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:40.181954 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-7da62eba-c873-47ab-99d0-8f46143a35e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:40.190434 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-7da62eba-c873-47ab-99d0-8f46143a35e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 200 len: 1367 microversion: 2.1 time: 0.154982 Sep 05 12:33:40.191006 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 298/598] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:40 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:40.741289 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-37637c1c-2abc-4d77-a406-d2380ab3228b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:40.741824 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-37637c1c-2abc-4d77-a406-d2380ab3228b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:40.744300 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:40.749066 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-37637c1c-2abc-4d77-a406-d2380ab3228b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:40.749560 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-37637c1c-2abc-4d77-a406-d2380ab3228b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:40.749996 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-37637c1c-2abc-4d77-a406-d2380ab3228b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:40.750699 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-37637c1c-2abc-4d77-a406-d2380ab3228b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:40.751155 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-37637c1c-2abc-4d77-a406-d2380ab3228b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:40.751619 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-37637c1c-2abc-4d77-a406-d2380ab3228b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:40.897722 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-37637c1c-2abc-4d77-a406-d2380ab3228b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:40.907685 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-37637c1c-2abc-4d77-a406-d2380ab3228b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1735 microversion: 2.1 time: 0.170434 Sep 05 12:33:40.908347 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 301/599] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:40 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:41.213358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-892289c8-2d59-4002-bf1b-3ca3ba54b64f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:41.217050 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-892289c8-2d59-4002-bf1b-3ca3ba54b64f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:41.217050 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:41.221007 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-892289c8-2d59-4002-bf1b-3ca3ba54b64f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:41.221496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-892289c8-2d59-4002-bf1b-3ca3ba54b64f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:41.221927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-892289c8-2d59-4002-bf1b-3ca3ba54b64f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:41.222754 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-892289c8-2d59-4002-bf1b-3ca3ba54b64f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:41.223210 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-892289c8-2d59-4002-bf1b-3ca3ba54b64f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:41.223663 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-892289c8-2d59-4002-bf1b-3ca3ba54b64f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:41.364414 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-892289c8-2d59-4002-bf1b-3ca3ba54b64f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:41.372889 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-892289c8-2d59-4002-bf1b-3ca3ba54b64f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 200 len: 1367 microversion: 2.1 time: 0.163284 Sep 05 12:33:41.373501 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 299/600] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:41 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:41.931556 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1632d4bf-4a9e-4559-b8f6-64f14709a21b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:41.932404 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1632d4bf-4a9e-4559-b8f6-64f14709a21b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:41.939675 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1632d4bf-4a9e-4559-b8f6-64f14709a21b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:41.939999 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1632d4bf-4a9e-4559-b8f6-64f14709a21b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:41.940276 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1632d4bf-4a9e-4559-b8f6-64f14709a21b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:41.941415 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1632d4bf-4a9e-4559-b8f6-64f14709a21b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:41.941875 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1632d4bf-4a9e-4559-b8f6-64f14709a21b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:41.942336 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1632d4bf-4a9e-4559-b8f6-64f14709a21b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:42.008141 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d04e6920-e870-4692-9f96-ed67dd2c4b64 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:42.008793 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d04e6920-e870-4692-9f96-ed67dd2c4b64 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:42.011607 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=2 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:42.012569 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=6 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:42.018913 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d04e6920-e870-4692-9f96-ed67dd2c4b64 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:42.020802 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d04e6920-e870-4692-9f96-ed67dd2c4b64 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:42.020802 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d04e6920-e870-4692-9f96-ed67dd2c4b64 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:42.020802 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d04e6920-e870-4692-9f96-ed67dd2c4b64 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:42.021112 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d04e6920-e870-4692-9f96-ed67dd2c4b64 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:42.021475 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d04e6920-e870-4692-9f96-ed67dd2c4b64 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:42.061013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d04e6920-e870-4692-9f96-ed67dd2c4b64 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/os-volume_attachments/33032ce3-0e9f-4da4-8585-1fbedb4e7676" status: 200 len: 194 microversion: 2.20 time: 0.053040 Sep 05 12:33:42.061013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 300/601] 10.222.0.62 () {60 vars in 1454 bytes} [Mon Sep 5 12:33:42 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/os-volume_attachments/33032ce3-0e9f-4da4-8585-1fbedb4e7676 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 12:33:42.071496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=6 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:42.095947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1632d4bf-4a9e-4559-b8f6-64f14709a21b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:42.105560 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1632d4bf-4a9e-4559-b8f6-64f14709a21b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1735 microversion: 2.1 time: 0.177768 Sep 05 12:33:42.106150 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 302/602] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:41 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:42.142569 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-2c2cf4b9-37e2-44e3-80f7-761cf6c9a331 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:42.143194 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-2c2cf4b9-37e2-44e3-80f7-761cf6c9a331 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:42.149313 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2c2cf4b9-37e2-44e3-80f7-761cf6c9a331 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:42.149803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2c2cf4b9-37e2-44e3-80f7-761cf6c9a331 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:42.150240 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2c2cf4b9-37e2-44e3-80f7-761cf6c9a331 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:42.150939 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2c2cf4b9-37e2-44e3-80f7-761cf6c9a331 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:42.151418 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2c2cf4b9-37e2-44e3-80f7-761cf6c9a331 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:42.151873 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2c2cf4b9-37e2-44e3-80f7-761cf6c9a331 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:42.237918 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.objects.instance [None req-2c2cf4b9-37e2-44e3-80f7-761cf6c9a331 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lazy-loading 'services' on Instance uuid a0105c66-6939-4b6d-b774-c1821012c1f0 {{(pid=121211) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:33:42.395849 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-f822e36e-f2b8-4414-aeb0-4ef022ad1589 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:42.396483 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-f822e36e-f2b8-4414-aeb0-4ef022ad1589 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:42.402506 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f822e36e-f2b8-4414-aeb0-4ef022ad1589 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:42.402991 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f822e36e-f2b8-4414-aeb0-4ef022ad1589 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:42.403502 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f822e36e-f2b8-4414-aeb0-4ef022ad1589 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:42.404155 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f822e36e-f2b8-4414-aeb0-4ef022ad1589 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:42.404609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f822e36e-f2b8-4414-aeb0-4ef022ad1589 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:42.405278 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f822e36e-f2b8-4414-aeb0-4ef022ad1589 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:42.506022 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-2c2cf4b9-37e2-44e3-80f7-761cf6c9a331 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/os-volume_attachments/33032ce3-0e9f-4da4-8585-1fbedb4e7676" status: 202 len: 0 microversion: 2.20 time: 0.367272 Sep 05 12:33:42.507847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 301/603] 10.222.0.62 () {60 vars in 1457 bytes} [Mon Sep 5 12:33:42 2022] DELETE /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/os-volume_attachments/33032ce3-0e9f-4da4-8585-1fbedb4e7676 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:33:42.515643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e8ff064b-1f0c-4669-b8e8-3f524121bd3f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:42.517968 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e8ff064b-1f0c-4669-b8e8-3f524121bd3f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:42.524170 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8ff064b-1f0c-4669-b8e8-3f524121bd3f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:42.524655 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8ff064b-1f0c-4669-b8e8-3f524121bd3f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:42.525165 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8ff064b-1f0c-4669-b8e8-3f524121bd3f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:42.527093 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8ff064b-1f0c-4669-b8e8-3f524121bd3f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:42.527581 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8ff064b-1f0c-4669-b8e8-3f524121bd3f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:42.530803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8ff064b-1f0c-4669-b8e8-3f524121bd3f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:42.544590 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f822e36e-f2b8-4414-aeb0-4ef022ad1589 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:42.550417 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:42.559456 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-f822e36e-f2b8-4414-aeb0-4ef022ad1589 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 200 len: 1367 microversion: 2.1 time: 0.165799 Sep 05 12:33:42.559456 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 303/604] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:42 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:33:42.570631 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e8ff064b-1f0c-4669-b8e8-3f524121bd3f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059303 Sep 05 12:33:42.575755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 302/605] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Sep 5 12:33:42 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 12:33:43.130570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-924c7c03-0512-4563-8d36-1ffc7d8673c2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:43.131226 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-924c7c03-0512-4563-8d36-1ffc7d8673c2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:43.138611 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-924c7c03-0512-4563-8d36-1ffc7d8673c2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:43.139107 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-924c7c03-0512-4563-8d36-1ffc7d8673c2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:43.139583 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-924c7c03-0512-4563-8d36-1ffc7d8673c2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:43.140300 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-924c7c03-0512-4563-8d36-1ffc7d8673c2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:43.140755 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-924c7c03-0512-4563-8d36-1ffc7d8673c2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:43.141181 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-924c7c03-0512-4563-8d36-1ffc7d8673c2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:43.242082 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-a334fc52-1321-4c9a-bcbc-bd81d932712f req-3848853b-a605-4da5-bb28-e7cd0687786c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d85243e-7c92-4640-8c2d-72c79cf18d76", "name": "network-vif-plugged", "status": "completed", "tag": "b6f5eb31-8603-45c5-8275-77ad7a36982d"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:33:43.254495 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-a334fc52-1321-4c9a-bcbc-bd81d932712f req-3848853b-a605-4da5-bb28-e7cd0687786c service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:43.255082 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-a334fc52-1321-4c9a-bcbc-bd81d932712f req-3848853b-a605-4da5-bb28-e7cd0687786c service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:43.255611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-a334fc52-1321-4c9a-bcbc-bd81d932712f req-3848853b-a605-4da5-bb28-e7cd0687786c service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:43.267466 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-a334fc52-1321-4c9a-bcbc-bd81d932712f req-3848853b-a605-4da5-bb28-e7cd0687786c service nova] Creating event network-vif-plugged:b6f5eb31-8603-45c5-8275-77ad7a36982d for instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 on hv-cinder-80135 Sep 05 12:33:43.272588 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-a334fc52-1321-4c9a-bcbc-bd81d932712f req-3848853b-a605-4da5-bb28-e7cd0687786c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034542 Sep 05 12:33:43.273295 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 303/606] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:33:43.291455 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-924c7c03-0512-4563-8d36-1ffc7d8673c2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:43.299899 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-924c7c03-0512-4563-8d36-1ffc7d8673c2 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1735 microversion: 2.1 time: 0.173344 Sep 05 12:33:43.300473 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 304/607] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:43 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:43.583454 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-91790810-b93c-4741-b9a8-6f7e12e0ae37 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:43.584121 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-eaf56733-7dba-4e28-84f4-ab490f0b566c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:43.584822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-eaf56733-7dba-4e28-84f4-ab490f0b566c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:43.586786 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-91790810-b93c-4741-b9a8-6f7e12e0ae37 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:43.591623 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-eaf56733-7dba-4e28-84f4-ab490f0b566c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:43.592239 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-eaf56733-7dba-4e28-84f4-ab490f0b566c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:43.592690 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-eaf56733-7dba-4e28-84f4-ab490f0b566c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:43.592961 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-91790810-b93c-4741-b9a8-6f7e12e0ae37 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:43.593393 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-eaf56733-7dba-4e28-84f4-ab490f0b566c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:43.593493 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-91790810-b93c-4741-b9a8-6f7e12e0ae37 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:43.593851 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-eaf56733-7dba-4e28-84f4-ab490f0b566c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:43.593978 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-91790810-b93c-4741-b9a8-6f7e12e0ae37 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:43.594310 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-eaf56733-7dba-4e28-84f4-ab490f0b566c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:43.594564 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-91790810-b93c-4741-b9a8-6f7e12e0ae37 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:43.595023 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-91790810-b93c-4741-b9a8-6f7e12e0ae37 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:43.595445 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-91790810-b93c-4741-b9a8-6f7e12e0ae37 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:43.629176 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-91790810-b93c-4741-b9a8-6f7e12e0ae37 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049599 Sep 05 12:33:43.629975 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 305/608] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Sep 5 12:33:43 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:33:43.735387 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-eaf56733-7dba-4e28-84f4-ab490f0b566c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:43.743037 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-eaf56733-7dba-4e28-84f4-ab490f0b566c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 200 len: 1367 microversion: 2.1 time: 0.163474 Sep 05 12:33:43.746278 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 304/609] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:43 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:44.324441 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-74bd131f-dc87-48e1-90fa-956a4a1203bd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:44.325189 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-74bd131f-dc87-48e1-90fa-956a4a1203bd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:44.332083 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-74bd131f-dc87-48e1-90fa-956a4a1203bd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:44.332573 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-74bd131f-dc87-48e1-90fa-956a4a1203bd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:44.333002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-74bd131f-dc87-48e1-90fa-956a4a1203bd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:44.333716 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-74bd131f-dc87-48e1-90fa-956a4a1203bd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:44.334175 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-74bd131f-dc87-48e1-90fa-956a4a1203bd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:44.334590 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-74bd131f-dc87-48e1-90fa-956a4a1203bd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:44.485060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-74bd131f-dc87-48e1-90fa-956a4a1203bd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:44.490500 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-74bd131f-dc87-48e1-90fa-956a4a1203bd tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1715 microversion: 2.1 time: 0.170125 Sep 05 12:33:44.491294 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 306/610] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:44 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1715 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:44.606788 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7d748c47-0062-4ae1-a1a2-05a4769e32be tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:44.607328 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-7d748c47-0062-4ae1-a1a2-05a4769e32be tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:44.614153 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7d748c47-0062-4ae1-a1a2-05a4769e32be tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:44.614641 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7d748c47-0062-4ae1-a1a2-05a4769e32be tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:44.615080 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7d748c47-0062-4ae1-a1a2-05a4769e32be tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:44.615811 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7d748c47-0062-4ae1-a1a2-05a4769e32be tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:44.616317 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7d748c47-0062-4ae1-a1a2-05a4769e32be tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:44.616743 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7d748c47-0062-4ae1-a1a2-05a4769e32be tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:44.642861 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-c3611463-ac7e-476c-af8c-035e524cf6c2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:44.645147 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-c3611463-ac7e-476c-af8c-035e524cf6c2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:44.651747 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c3611463-ac7e-476c-af8c-035e524cf6c2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:44.652238 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c3611463-ac7e-476c-af8c-035e524cf6c2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:44.653262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c3611463-ac7e-476c-af8c-035e524cf6c2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:44.653962 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c3611463-ac7e-476c-af8c-035e524cf6c2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:44.654584 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c3611463-ac7e-476c-af8c-035e524cf6c2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:44.655010 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c3611463-ac7e-476c-af8c-035e524cf6c2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:44.686108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-c3611463-ac7e-476c-af8c-035e524cf6c2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047256 Sep 05 12:33:44.686820 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 307/611] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Sep 5 12:33:44 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 12:33:44.708624 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-7d748c47-0062-4ae1-a1a2-05a4769e32be tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] HTTP exception thrown: Cannot 'detach_volume' instance c86e0b82-f349-40c6-986b-359cb36a9862 while it is in vm_state rescued Sep 05 12:33:44.710358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7d748c47-0062-4ae1-a1a2-05a4769e32be tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Request method failure captured: Sep 05 12:33:44.710358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: DELETE /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments/e2294d56-f5d6-43da-b238-8fdb69187179 HTTP/1.1 Sep 05 12:33:44.710358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:33:44.710358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:33:44.710358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:33:44.710358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:33:44.710358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:33:44.710358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:33:44.710358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:33:44.710358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:33:44.710358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFeum8bx5jyveF85UtCG36zw6ZW7Ho89ZdS6sAhd29-DgS8z8mX-sxztHgo8dEEIhPTiA0DvlBnCKqmEaegTdojqUwYbH3yXd1WqKjjFpLp0dzFo0kaeLBSaKV5jpy-kf5GWYU61zSOo9eRrpikFnOvGyJFTC23WpaNWLxZkymGt-fS4 Sep 05 12:33:44.710358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:33:44.710358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:33:44.710358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:33:44.710358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:33:44.710358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:33:44.710358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:33:44.710358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 442bf64c97d945feb79f64cdd66baa28 Sep 05 12:33:44.710358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1766995040 Sep 05 12:33:44.710358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:33:44.710358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:33:44.712022 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/442bf64c97d945feb79f64cdd66baa28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/442bf64c97d945feb79f64cdd66baa28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/442bf64c97d945feb79f64cdd66baa28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_442bf64c97d945feb79f64cdd66baa28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:33:44.712022 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1766995040 Sep 05 12:33:44.712022 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 442bf64c97d945feb79f64cdd66baa28 Sep 05 12:33:44.712022 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1766995040 Sep 05 12:33:44.712022 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-ServerRescueNegativeTestJSON-1766995040-project Sep 05 12:33:44.712022 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:33:44.712022 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:33:44.712022 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: f5543fbd902d441cb6f03d3155f1af8d Sep 05 12:33:44.712022 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1766995040-project Sep 05 12:33:44.712022 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: > Sep 05 12:33:44.712022 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Cannot 'detach_volume' instance c86e0b82-f349-40c6-986b-359cb36a9862 while it is in vm_state rescued Sep 05 12:33:44.712922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'server_id': 'c86e0b82-f349-40c6-986b-359cb36a9862', 'id': 'e2294d56-f5d6-43da-b238-8fdb69187179'} Sep 05 12:33:44.712922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:33:44.712922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:33:44.712922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 05 12:33:44.712922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 05 12:33:44.712922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 12:33:44.712922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 12:33:44.712922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 05 12:33:44.712922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 05 12:33:44.712922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c86e0b82-f349-40c6-986b-359cb36a9862 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 05 12:33:44.712922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:33:44.712922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:33:44.712922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:33:44.712922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:33:44.712922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:33:44.712922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:33:44.712922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:33:44.712922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:33:44.712922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:33:44.712922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:33:44.714212 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 05 12:33:44.714212 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 05 12:33:44.714212 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 05 12:33:44.714212 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 05 12:33:44.714212 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c86e0b82-f349-40c6-986b-359cb36a9862 while it is in vm_state rescued Sep 05 12:33:44.714212 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:33:44.714212 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:33:44.714212 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:33:44.714212 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:33:44.714212 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:33:44.714212 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:33:44.714212 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:33:44.714212 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:33:44.714212 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c86e0b82-f349-40c6-986b-359cb36a9862 while it is in vm_state rescued Sep 05 12:33:44.714212 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:33:44.714212 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7d748c47-0062-4ae1-a1a2-05a4769e32be tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Returning 409 to user: Cannot 'detach_volume' instance c86e0b82-f349-40c6-986b-359cb36a9862 while it is in vm_state rescued {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:33:44.715875 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-7d748c47-0062-4ae1-a1a2-05a4769e32be tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments/e2294d56-f5d6-43da-b238-8fdb69187179" status: 409 len: 152 microversion: 2.1 time: 0.109353 Sep 05 12:33:44.715875 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 305/612] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Sep 5 12:33:44 2022] DELETE /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments/e2294d56-f5d6-43da-b238-8fdb69187179 => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 05 12:33:44.721467 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1be33160-773c-42bb-adc6-53f63747395b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:33:44.721992 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1be33160-773c-42bb-adc6-53f63747395b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:44.727909 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1be33160-773c-42bb-adc6-53f63747395b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:44.728385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1be33160-773c-42bb-adc6-53f63747395b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:44.728811 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1be33160-773c-42bb-adc6-53f63747395b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:44.729496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1be33160-773c-42bb-adc6-53f63747395b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:44.730556 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1be33160-773c-42bb-adc6-53f63747395b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:44.730556 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1be33160-773c-42bb-adc6-53f63747395b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:44.766695 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ed67eade-6009-4010-9e50-b3429f579a85 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:44.767345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ed67eade-6009-4010-9e50-b3429f579a85 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:44.774152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ed67eade-6009-4010-9e50-b3429f579a85 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:44.774636 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ed67eade-6009-4010-9e50-b3429f579a85 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:44.775070 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ed67eade-6009-4010-9e50-b3429f579a85 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:44.775808 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ed67eade-6009-4010-9e50-b3429f579a85 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:44.776281 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ed67eade-6009-4010-9e50-b3429f579a85 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:44.776722 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ed67eade-6009-4010-9e50-b3429f579a85 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:44.894316 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:44.909175 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ed67eade-6009-4010-9e50-b3429f579a85 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:44.919107 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ed67eade-6009-4010-9e50-b3429f579a85 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 200 len: 1367 microversion: 2.1 time: 0.154726 Sep 05 12:33:44.920031 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 306/613] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:44 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:44.985066 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1be33160-773c-42bb-adc6-53f63747395b tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "POST /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/action" status: 202 len: 0 microversion: 2.1 time: 0.267368 Sep 05 12:33:44.989385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 308/614] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Sep 5 12:33:44 2022] POST /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:33:44.993780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d1415c04-d84f-4764-ae07-0128dc8ca628 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:44.994394 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d1415c04-d84f-4764-ae07-0128dc8ca628 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:45.000995 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d1415c04-d84f-4764-ae07-0128dc8ca628 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:45.001487 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d1415c04-d84f-4764-ae07-0128dc8ca628 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:45.001920 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d1415c04-d84f-4764-ae07-0128dc8ca628 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:45.002609 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d1415c04-d84f-4764-ae07-0128dc8ca628 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:45.003065 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d1415c04-d84f-4764-ae07-0128dc8ca628 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:45.003556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d1415c04-d84f-4764-ae07-0128dc8ca628 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:45.140421 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d1415c04-d84f-4764-ae07-0128dc8ca628 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:45.149075 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d1415c04-d84f-4764-ae07-0128dc8ca628 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1723 microversion: 2.1 time: 0.159148 Sep 05 12:33:45.149647 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 307/615] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:44 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:33:45.702151 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d3f77924-629f-4a46-80fe-1402aaec3bb2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:45.704352 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d3f77924-629f-4a46-80fe-1402aaec3bb2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:45.711073 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d3f77924-629f-4a46-80fe-1402aaec3bb2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:45.711581 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d3f77924-629f-4a46-80fe-1402aaec3bb2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:45.712016 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d3f77924-629f-4a46-80fe-1402aaec3bb2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:45.712719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d3f77924-629f-4a46-80fe-1402aaec3bb2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:45.713173 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d3f77924-629f-4a46-80fe-1402aaec3bb2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:45.713586 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d3f77924-629f-4a46-80fe-1402aaec3bb2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:45.744681 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d3f77924-629f-4a46-80fe-1402aaec3bb2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047843 Sep 05 12:33:45.746616 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 309/616] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Sep 5 12:33:45 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:45.810513 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d9b4e245-fd7c-40f4-be2b-9668f02d1149 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:45.811060 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d9b4e245-fd7c-40f4-be2b-9668f02d1149 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:45.817654 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d9b4e245-fd7c-40f4-be2b-9668f02d1149 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:45.818132 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d9b4e245-fd7c-40f4-be2b-9668f02d1149 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:45.818560 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d9b4e245-fd7c-40f4-be2b-9668f02d1149 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:45.819253 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d9b4e245-fd7c-40f4-be2b-9668f02d1149 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:45.819734 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d9b4e245-fd7c-40f4-be2b-9668f02d1149 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:45.820152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d9b4e245-fd7c-40f4-be2b-9668f02d1149 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:45.847239 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d9b4e245-fd7c-40f4-be2b-9668f02d1149 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Going to try to terminate instance {{(pid=121211) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:33:45.942488 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1712a53a-90f8-4ceb-9c05-6786598d6068 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:45.943099 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1712a53a-90f8-4ceb-9c05-6786598d6068 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:45.950207 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1712a53a-90f8-4ceb-9c05-6786598d6068 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:45.950697 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1712a53a-90f8-4ceb-9c05-6786598d6068 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:45.951128 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1712a53a-90f8-4ceb-9c05-6786598d6068 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:45.951866 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1712a53a-90f8-4ceb-9c05-6786598d6068 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:45.952379 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1712a53a-90f8-4ceb-9c05-6786598d6068 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:45.952781 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1712a53a-90f8-4ceb-9c05-6786598d6068 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:46.092488 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1712a53a-90f8-4ceb-9c05-6786598d6068 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:46.098208 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1712a53a-90f8-4ceb-9c05-6786598d6068 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 200 len: 1367 microversion: 2.1 time: 0.159597 Sep 05 12:33:46.098778 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 310/617] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:45 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:33:46.173171 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-01665db8-799a-4954-869e-2f32ebe3cd82 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:46.173967 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-01665db8-799a-4954-869e-2f32ebe3cd82 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:46.180611 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-01665db8-799a-4954-869e-2f32ebe3cd82 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:46.181237 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-01665db8-799a-4954-869e-2f32ebe3cd82 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:46.181749 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-01665db8-799a-4954-869e-2f32ebe3cd82 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:46.182533 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-01665db8-799a-4954-869e-2f32ebe3cd82 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:46.183057 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-01665db8-799a-4954-869e-2f32ebe3cd82 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:46.183660 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-01665db8-799a-4954-869e-2f32ebe3cd82 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:46.214287 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d9b4e245-fd7c-40f4-be2b-9668f02d1149 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 204 len: 0 microversion: 2.20 time: 0.407535 Sep 05 12:33:46.214882 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 308/618] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Sep 5 12:33:45 2022] DELETE /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 05 12:33:46.224352 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0bd948a1-5261-446c-9884-3ef15be9ac39 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:46.225060 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0bd948a1-5261-446c-9884-3ef15be9ac39 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:46.232223 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0bd948a1-5261-446c-9884-3ef15be9ac39 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:46.233084 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0bd948a1-5261-446c-9884-3ef15be9ac39 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:46.233761 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0bd948a1-5261-446c-9884-3ef15be9ac39 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:46.234713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0bd948a1-5261-446c-9884-3ef15be9ac39 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:46.235161 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0bd948a1-5261-446c-9884-3ef15be9ac39 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:46.235619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0bd948a1-5261-446c-9884-3ef15be9ac39 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:46.352985 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-01665db8-799a-4954-869e-2f32ebe3cd82 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:46.362051 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-01665db8-799a-4954-869e-2f32ebe3cd82 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1723 microversion: 2.1 time: 0.192775 Sep 05 12:33:46.362638 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 311/619] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:46 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:33:46.395172 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0bd948a1-5261-446c-9884-3ef15be9ac39 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:46.403717 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0bd948a1-5261-446c-9884-3ef15be9ac39 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:46.405218 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0bd948a1-5261-446c-9884-3ef15be9ac39 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:46.406424 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0bd948a1-5261-446c-9884-3ef15be9ac39 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1722 microversion: 2.20 time: 0.186650 Sep 05 12:33:46.406968 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 309/620] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:33:46 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:33:47.121012 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d2edb136-549b-45fe-b326-cba0e95a6e21 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:47.121626 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d2edb136-549b-45fe-b326-cba0e95a6e21 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:47.128550 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d2edb136-549b-45fe-b326-cba0e95a6e21 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:47.129041 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d2edb136-549b-45fe-b326-cba0e95a6e21 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:47.129566 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d2edb136-549b-45fe-b326-cba0e95a6e21 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:47.130363 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d2edb136-549b-45fe-b326-cba0e95a6e21 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:47.130851 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d2edb136-549b-45fe-b326-cba0e95a6e21 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:47.131335 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d2edb136-549b-45fe-b326-cba0e95a6e21 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:47.266939 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d2edb136-549b-45fe-b326-cba0e95a6e21 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:47.274656 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d2edb136-549b-45fe-b326-cba0e95a6e21 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 200 len: 1557 microversion: 2.1 time: 0.157846 Sep 05 12:33:47.275216 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 312/621] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:47 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:47.298190 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-00dd2ca3-db64-488e-ae58-d8f4ac33c019 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:47.300765 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-00dd2ca3-db64-488e-ae58-d8f4ac33c019 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:47.305311 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-00dd2ca3-db64-488e-ae58-d8f4ac33c019 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:47.305726 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-00dd2ca3-db64-488e-ae58-d8f4ac33c019 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:47.306163 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-00dd2ca3-db64-488e-ae58-d8f4ac33c019 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:47.306863 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-00dd2ca3-db64-488e-ae58-d8f4ac33c019 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:47.307317 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-00dd2ca3-db64-488e-ae58-d8f4ac33c019 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:47.307778 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-00dd2ca3-db64-488e-ae58-d8f4ac33c019 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:47.385852 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-00dd2ca3-db64-488e-ae58-d8f4ac33c019 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092201 Sep 05 12:33:47.386556 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-586e894f-6e77-449f-b08a-f517fb69ecb0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:47.386718 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 310/622] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Sep 5 12:33:47 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:33:47.386991 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-586e894f-6e77-449f-b08a-f517fb69ecb0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:47.393293 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-586e894f-6e77-449f-b08a-f517fb69ecb0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:47.394011 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-586e894f-6e77-449f-b08a-f517fb69ecb0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:47.394449 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-586e894f-6e77-449f-b08a-f517fb69ecb0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:47.395163 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-586e894f-6e77-449f-b08a-f517fb69ecb0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:47.395649 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-586e894f-6e77-449f-b08a-f517fb69ecb0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:47.396077 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-586e894f-6e77-449f-b08a-f517fb69ecb0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:47.432103 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-306abe46-17f4-47e9-a6e3-e339d7f81dbf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:47.432709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-306abe46-17f4-47e9-a6e3-e339d7f81dbf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:47.439995 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-306abe46-17f4-47e9-a6e3-e339d7f81dbf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:47.440484 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-306abe46-17f4-47e9-a6e3-e339d7f81dbf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:47.440920 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-306abe46-17f4-47e9-a6e3-e339d7f81dbf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:47.441630 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-306abe46-17f4-47e9-a6e3-e339d7f81dbf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:47.442083 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-306abe46-17f4-47e9-a6e3-e339d7f81dbf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:47.442669 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-306abe46-17f4-47e9-a6e3-e339d7f81dbf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:47.532666 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-586e894f-6e77-449f-b08a-f517fb69ecb0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:47.545948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-586e894f-6e77-449f-b08a-f517fb69ecb0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1723 microversion: 2.1 time: 0.159535 Sep 05 12:33:47.545948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 313/623] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:47 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:47.721121 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-306abe46-17f4-47e9-a6e3-e339d7f81dbf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:47.732850 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-306abe46-17f4-47e9-a6e3-e339d7f81dbf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:47.733756 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-306abe46-17f4-47e9-a6e3-e339d7f81dbf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:47.735973 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-306abe46-17f4-47e9-a6e3-e339d7f81dbf tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1722 microversion: 2.20 time: 0.307387 Sep 05 12:33:47.736585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 311/624] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:33:47 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:33:48.568126 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-69800f80-c22e-4bb4-9e38-7d8cb9d006ef tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:48.570455 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-69800f80-c22e-4bb4-9e38-7d8cb9d006ef tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:48.578791 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-69800f80-c22e-4bb4-9e38-7d8cb9d006ef tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:48.579567 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-69800f80-c22e-4bb4-9e38-7d8cb9d006ef tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:48.580026 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-69800f80-c22e-4bb4-9e38-7d8cb9d006ef tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:48.580742 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-69800f80-c22e-4bb4-9e38-7d8cb9d006ef tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:48.581187 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-69800f80-c22e-4bb4-9e38-7d8cb9d006ef tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:48.581791 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-69800f80-c22e-4bb4-9e38-7d8cb9d006ef tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:48.742188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-69800f80-c22e-4bb4-9e38-7d8cb9d006ef tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:48.764943 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-39cd971c-4fce-400e-85b4-a27a0202c25d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:48.765966 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-39cd971c-4fce-400e-85b4-a27a0202c25d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:48.769514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-69800f80-c22e-4bb4-9e38-7d8cb9d006ef tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1723 microversion: 2.1 time: 0.191888 Sep 05 12:33:48.770282 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 314/625] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:48 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:48.781741 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-39cd971c-4fce-400e-85b4-a27a0202c25d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:48.782439 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-39cd971c-4fce-400e-85b4-a27a0202c25d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:48.783217 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-39cd971c-4fce-400e-85b4-a27a0202c25d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:48.784196 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-39cd971c-4fce-400e-85b4-a27a0202c25d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:48.785003 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-39cd971c-4fce-400e-85b4-a27a0202c25d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:48.786078 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-39cd971c-4fce-400e-85b4-a27a0202c25d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:49.165172 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-39cd971c-4fce-400e-85b4-a27a0202c25d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:49.173510 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-39cd971c-4fce-400e-85b4-a27a0202c25d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:49.175245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-39cd971c-4fce-400e-85b4-a27a0202c25d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:49.176759 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-39cd971c-4fce-400e-85b4-a27a0202c25d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1722 microversion: 2.20 time: 0.418067 Sep 05 12:33:49.177565 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 312/626] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:33:48 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1722 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:33:49.438373 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-e532fdfd-e2d0-4fa7-8535-6dbd22988f2a req-724e038c-7e3c-4c11-943b-13d8ec3d529c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d85243e-7c92-4640-8c2d-72c79cf18d76", "tag": "b6f5eb31-8603-45c5-8275-77ad7a36982d"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:33:49.448236 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-e532fdfd-e2d0-4fa7-8535-6dbd22988f2a req-724e038c-7e3c-4c11-943b-13d8ec3d529c service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:49.448962 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-e532fdfd-e2d0-4fa7-8535-6dbd22988f2a req-724e038c-7e3c-4c11-943b-13d8ec3d529c service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:49.449382 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-e532fdfd-e2d0-4fa7-8535-6dbd22988f2a req-724e038c-7e3c-4c11-943b-13d8ec3d529c service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:49.461308 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-e532fdfd-e2d0-4fa7-8535-6dbd22988f2a req-724e038c-7e3c-4c11-943b-13d8ec3d529c service nova] Creating event network-changed:b6f5eb31-8603-45c5-8275-77ad7a36982d for instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 on hv-cinder-80135 Sep 05 12:33:49.467014 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-e532fdfd-e2d0-4fa7-8535-6dbd22988f2a req-724e038c-7e3c-4c11-943b-13d8ec3d529c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035813 Sep 05 12:33:49.467627 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 315/627] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:33:49.794427 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8e4898f7-85e6-4133-b23f-d9991a0da58e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:49.798061 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-8e4898f7-85e6-4133-b23f-d9991a0da58e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:49.802332 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8e4898f7-85e6-4133-b23f-d9991a0da58e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:49.803121 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8e4898f7-85e6-4133-b23f-d9991a0da58e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:49.803755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8e4898f7-85e6-4133-b23f-d9991a0da58e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:49.804646 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8e4898f7-85e6-4133-b23f-d9991a0da58e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:49.805249 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8e4898f7-85e6-4133-b23f-d9991a0da58e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:49.805844 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8e4898f7-85e6-4133-b23f-d9991a0da58e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:50.062944 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-8e4898f7-85e6-4133-b23f-d9991a0da58e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:50.082447 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-8e4898f7-85e6-4133-b23f-d9991a0da58e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1723 microversion: 2.1 time: 0.289556 Sep 05 12:33:50.084009 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 313/628] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:49 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:50.205816 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-3374c591-7129-46f6-bece-af1d75740b88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:50.206825 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-3374c591-7129-46f6-bece-af1d75740b88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:50.214752 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3374c591-7129-46f6-bece-af1d75740b88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:50.215745 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3374c591-7129-46f6-bece-af1d75740b88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:50.217041 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3374c591-7129-46f6-bece-af1d75740b88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:50.218119 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3374c591-7129-46f6-bece-af1d75740b88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:50.218756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3374c591-7129-46f6-bece-af1d75740b88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:50.219179 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3374c591-7129-46f6-bece-af1d75740b88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:50.336544 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-3374c591-7129-46f6-bece-af1d75740b88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:50.356461 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-3374c591-7129-46f6-bece-af1d75740b88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:50.358806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-3374c591-7129-46f6-bece-af1d75740b88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:50.360541 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-3374c591-7129-46f6-bece-af1d75740b88 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1655 microversion: 2.20 time: 0.159281 Sep 05 12:33:50.363794 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 316/629] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:33:50 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1655 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:33:51.109138 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8c7b9296-1aa9-44a1-a961-4f93e224a673 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:51.110026 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-8c7b9296-1aa9-44a1-a961-4f93e224a673 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:51.119937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8c7b9296-1aa9-44a1-a961-4f93e224a673 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:51.121143 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8c7b9296-1aa9-44a1-a961-4f93e224a673 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:51.123038 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8c7b9296-1aa9-44a1-a961-4f93e224a673 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:51.124065 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8c7b9296-1aa9-44a1-a961-4f93e224a673 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:51.124746 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8c7b9296-1aa9-44a1-a961-4f93e224a673 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:51.126335 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8c7b9296-1aa9-44a1-a961-4f93e224a673 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:51.333848 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-8c7b9296-1aa9-44a1-a961-4f93e224a673 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:51.342364 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-8c7b9296-1aa9-44a1-a961-4f93e224a673 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1729 microversion: 2.1 time: 0.238803 Sep 05 12:33:51.347704 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 314/630] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:33:51 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1729 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:33:51.367505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-f9a2d506-286c-429a-806f-deecbcf92236 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:51.368144 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-f9a2d506-286c-429a-806f-deecbcf92236 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:51.375580 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f9a2d506-286c-429a-806f-deecbcf92236 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:51.376298 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f9a2d506-286c-429a-806f-deecbcf92236 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:51.376887 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f9a2d506-286c-429a-806f-deecbcf92236 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:51.377610 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f9a2d506-286c-429a-806f-deecbcf92236 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:51.378070 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f9a2d506-286c-429a-806f-deecbcf92236 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:51.378908 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f9a2d506-286c-429a-806f-deecbcf92236 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:51.386450 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d847bcc0-20c1-427e-b285-971cb0413811 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:51.387242 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d847bcc0-20c1-427e-b285-971cb0413811 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:51.393700 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d847bcc0-20c1-427e-b285-971cb0413811 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:51.394496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d847bcc0-20c1-427e-b285-971cb0413811 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:51.394936 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d847bcc0-20c1-427e-b285-971cb0413811 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:51.396423 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d847bcc0-20c1-427e-b285-971cb0413811 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:51.396886 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d847bcc0-20c1-427e-b285-971cb0413811 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:51.397324 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d847bcc0-20c1-427e-b285-971cb0413811 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:51.433104 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d847bcc0-20c1-427e-b285-971cb0413811 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:51.433589 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d847bcc0-20c1-427e-b285-971cb0413811 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:51.434017 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d847bcc0-20c1-427e-b285-971cb0413811 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:51.437159 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.objects.instance [None req-d847bcc0-20c1-427e-b285-971cb0413811 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lazy-loading 'fault' on Instance uuid a0105c66-6939-4b6d-b774-c1821012c1f0 {{(pid=121211) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:33:51.480077 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-f9a2d506-286c-429a-806f-deecbcf92236 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115580 Sep 05 12:33:51.481247 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 317/631] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Sep 5 12:33:51 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:33:51.485359 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d847bcc0-20c1-427e-b285-971cb0413811 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:51.491029 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-d0d3382a-d9b0-4c6a-a5d9-07511b002dd9 req-eb2e7569-2a1d-4310-8664-51484809d8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0105c66-6939-4b6d-b774-c1821012c1f0", "name": "network-vif-deleted", "tag": "09dffb1b-f334-42d1-bd74-8b59ed4648c3"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:33:51.500639 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d847bcc0-20c1-427e-b285-971cb0413811 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:51.501871 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-d0d3382a-d9b0-4c6a-a5d9-07511b002dd9 req-eb2e7569-2a1d-4310-8664-51484809d8f8 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:51.502157 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d847bcc0-20c1-427e-b285-971cb0413811 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:51.502791 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-d0d3382a-d9b0-4c6a-a5d9-07511b002dd9 req-eb2e7569-2a1d-4310-8664-51484809d8f8 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:51.503374 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d847bcc0-20c1-427e-b285-971cb0413811 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 200 len: 1371 microversion: 2.20 time: 0.121069 Sep 05 12:33:51.504209 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-d0d3382a-d9b0-4c6a-a5d9-07511b002dd9 req-eb2e7569-2a1d-4310-8664-51484809d8f8 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:51.504537 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 315/632] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:33:51 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 1371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:33:51.520345 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-d0d3382a-d9b0-4c6a-a5d9-07511b002dd9 req-eb2e7569-2a1d-4310-8664-51484809d8f8 service nova] Creating event network-vif-deleted:09dffb1b-f334-42d1-bd74-8b59ed4648c3 for instance a0105c66-6939-4b6d-b774-c1821012c1f0 on hv-cinder-80135 Sep 05 12:33:51.526579 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-d0d3382a-d9b0-4c6a-a5d9-07511b002dd9 req-eb2e7569-2a1d-4310-8664-51484809d8f8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042973 Sep 05 12:33:51.527285 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 318/633] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:33:52.529966 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-78fe0477-5333-4f36-bee8-c5d45dddd6c1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:52.531168 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-78fe0477-5333-4f36-bee8-c5d45dddd6c1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:52.538224 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-78fe0477-5333-4f36-bee8-c5d45dddd6c1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:52.538741 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-78fe0477-5333-4f36-bee8-c5d45dddd6c1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:52.539173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-78fe0477-5333-4f36-bee8-c5d45dddd6c1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:52.539907 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-78fe0477-5333-4f36-bee8-c5d45dddd6c1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:52.540392 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-78fe0477-5333-4f36-bee8-c5d45dddd6c1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:52.540780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-78fe0477-5333-4f36-bee8-c5d45dddd6c1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:52.555951 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-78fe0477-5333-4f36-bee8-c5d45dddd6c1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] HTTP exception thrown: Instance a0105c66-6939-4b6d-b774-c1821012c1f0 could not be found. Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-78fe0477-5333-4f36-bee8-c5d45dddd6c1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Request method failure captured: Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 HTTP/1.1 Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFeumSnTBVkpu6EglMHsXvEVreXN-ecouhECu3sHOydWwJQRqKYX1IbEHpcAOyupR0JZoOfJ4jP5Lfc7EWbVrDYx3pQNVWC2NDPZBKY-A_4JgQatZjCmiIQ9G2aOG3eLH761jTySfb7t7bz2LqLlcg7u8hqJHs9MYVXH-i6LHBelxddU Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 094bae935a1e4738b0c51d33c6d89e3a Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-793258417 Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:33:52.557642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:33:52.559112 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:33:52.559112 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-AttachVolumeShelveTestJSON-793258417 Sep 05 12:33:52.559112 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 094bae935a1e4738b0c51d33c6d89e3a Sep 05 12:33:52.559112 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-793258417 Sep 05 12:33:52.559112 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-AttachVolumeShelveTestJSON-793258417-project Sep 05 12:33:52.559112 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:33:52.559112 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:33:52.559112 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: 9a61a18900c44bea89647fc9ccdaf110 Sep 05 12:33:52.559112 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-AttachVolumeShelveTestJSON-793258417-project Sep 05 12:33:52.559112 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: > Sep 05 12:33:52.559112 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Instance a0105c66-6939-4b6d-b774-c1821012c1f0 could not be found. Sep 05 12:33:52.559112 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': 'a0105c66-6939-4b6d-b774-c1821012c1f0'} Sep 05 12:33:52.563509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:33:52.563509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:33:52.563509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:33:52.563509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:33:52.563509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:33:52.563509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:33:52.563509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:33:52.563509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:33:52.563509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:33:52.563509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:33:52.563509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0105c66-6939-4b6d-b774-c1821012c1f0 could not be found. Sep 05 12:33:52.563509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:33:52.563509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:33:52.563509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:33:52.563509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:33:52.563509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:33:52.563509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:33:52.563509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:33:52.563509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:33:52.563509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:33:52.565152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:33:52.565152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:33:52.565152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:33:52.565152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:33:52.565152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:33:52.565152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:33:52.565152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:33:52.565152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0105c66-6939-4b6d-b774-c1821012c1f0 could not be found. Sep 05 12:33:52.565152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:33:52.565152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:33:52.565152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:33:52.565152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:33:52.565152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:33:52.565152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:33:52.565152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:33:52.565152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:33:52.565152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0105c66-6939-4b6d-b774-c1821012c1f0 could not be found. Sep 05 12:33:52.565152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:33:52.568034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-78fe0477-5333-4f36-bee8-c5d45dddd6c1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Returning 404 to user: Instance a0105c66-6939-4b6d-b774-c1821012c1f0 could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:33:52.568034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-78fe0477-5333-4f36-bee8-c5d45dddd6c1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 404 len: 111 microversion: 2.20 time: 0.033760 Sep 05 12:33:52.568034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 316/634] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:33:52 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 05 12:33:52.570091 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d431a0f8-83e5-4d3a-b98c-3227adf35741 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '.version_select at 0x7fe712af2160>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:52.639184 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d431a0f8-83e5-4d3a-b98c-3227adf35741 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164867895" status: 204 len: 0 microversion: 2.20 time: 0.073580 Sep 05 12:33:52.639933 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 319/635] 10.222.0.62 () {60 vars in 1262 bytes} [Mon Sep 5 12:33:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164867895 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 05 12:33:53.559462 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-b7c32e98-d384-4255-b8bf-3f02850496b0 req-f358ed80-b13a-4b74-b550-700ae72693ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c86e0b82-f349-40c6-986b-359cb36a9862", "tag": "66947e6f-24aa-4efc-9fc1-09b650127cb3"}, {"name": "network-changed", "server_uuid": "c86e0b82-f349-40c6-986b-359cb36a9862", "tag": "66947e6f-24aa-4efc-9fc1-09b650127cb3"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:33:53.566548 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-777f930a-b5e0-4abb-b9be-5036ede84e4d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Action: 'create', calling method: .version_select at 0x7fe7128caf70>, body: {"keypair": {"name": "tempest-keypair-845969821", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJ6XQfq3A08tCzAS/oy1M9f8t1zN8fTc7BS26CxsEw1tvS/u92SkEQm7wQv+oscJDym/7cEFwVTgr1rokG6bR+3THT5au0GnMoaWv8TBvzudg36oomcOzNiqKVrLMBASw=="}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:33:53.575878 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-b7c32e98-d384-4255-b8bf-3f02850496b0 req-f358ed80-b13a-4b74-b550-700ae72693ef service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:53.576671 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-b7c32e98-d384-4255-b8bf-3f02850496b0 req-f358ed80-b13a-4b74-b550-700ae72693ef service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:53.577713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-b7c32e98-d384-4255-b8bf-3f02850496b0 req-f358ed80-b13a-4b74-b550-700ae72693ef service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:53.594255 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-b7c32e98-d384-4255-b8bf-3f02850496b0 req-f358ed80-b13a-4b74-b550-700ae72693ef service nova] Creating event network-changed:66947e6f-24aa-4efc-9fc1-09b650127cb3 for instance c86e0b82-f349-40c6-986b-359cb36a9862 on hv-cinder-80135 Sep 05 12:33:53.595450 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-b7c32e98-d384-4255-b8bf-3f02850496b0 req-f358ed80-b13a-4b74-b550-700ae72693ef service nova] Creating event network-changed:66947e6f-24aa-4efc-9fc1-09b650127cb3 for instance c86e0b82-f349-40c6-986b-359cb36a9862 on hv-cinder-80135 Sep 05 12:33:53.607918 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-b7c32e98-d384-4255-b8bf-3f02850496b0 req-f358ed80-b13a-4b74-b550-700ae72693ef service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.050718 Sep 05 12:33:53.607918 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 317/636] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:33:53.616100 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-777f930a-b5e0-4abb-b9be-5036ede84e4d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Getting quotas for project 094bae935a1e4738b0c51d33c6d89e3a. Resources: {'key_pairs'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:33:53.636601 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-777f930a-b5e0-4abb-b9be-5036ede84e4d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Getting quotas for user 9a61a18900c44bea89647fc9ccdaf110 and project 094bae935a1e4738b0c51d33c6d89e3a. Resources: {'key_pairs'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:33:53.736540 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-777f930a-b5e0-4abb-b9be-5036ede84e4d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.178976 Sep 05 12:33:53.737241 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 320/637] 10.222.0.62 () {62 vars in 1200 bytes} [Mon Sep 5 12:33:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 180 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 05 12:33:56.338959 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-2bbbe92d-c2d6-4efc-8b03-73017684abec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2064098712", "imageRef": "7844cf5b-4975-4cb9-a7f8-31cc5e52098a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63375a32-83e0-46aa-bf2e-0ee5e39b91e6"}], "security_groups": [{"name": "tempest-securitygroup--1514702896"}], "key_name": "tempest-keypair-845969821", "user_data": "}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:33:56.454445 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.network.neutron [None req-2bbbe92d-c2d6-4efc-8b03-73017684abec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] validate_networks() for [('63375a32-83e0-46aa-bf2e-0ee5e39b91e6', None, None, None, None, None)] {{(pid=121211) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:33:56.918506 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-2bbbe92d-c2d6-4efc-8b03-73017684abec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Flavor limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:33:56.919146 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-2bbbe92d-c2d6-4efc-8b03-73017684abec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Image limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:33:56.919902 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-2bbbe92d-c2d6-4efc-8b03-73017684abec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Flavor pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:33:56.920505 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-2bbbe92d-c2d6-4efc-8b03-73017684abec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Image pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:33:56.921237 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-2bbbe92d-c2d6-4efc-8b03-73017684abec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:33:56.937299 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2bbbe92d-c2d6-4efc-8b03-73017684abec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:56.938684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2bbbe92d-c2d6-4efc-8b03-73017684abec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:56.943101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2bbbe92d-c2d6-4efc-8b03-73017684abec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:56.943101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2bbbe92d-c2d6-4efc-8b03-73017684abec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:56.943101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2bbbe92d-c2d6-4efc-8b03-73017684abec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:56.943101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2bbbe92d-c2d6-4efc-8b03-73017684abec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:56.971421 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-2bbbe92d-c2d6-4efc-8b03-73017684abec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Getting quotas for project 094bae935a1e4738b0c51d33c6d89e3a. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:33:56.976254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-2bbbe92d-c2d6-4efc-8b03-73017684abec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Getting quotas for user 9a61a18900c44bea89647fc9ccdaf110 and project 094bae935a1e4738b0c51d33c6d89e3a. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:33:56.991642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-2bbbe92d-c2d6-4efc-8b03-73017684abec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Going to run 1 instances... {{(pid=121211) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:33:56.994242 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-2bbbe92d-c2d6-4efc-8b03-73017684abec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7844cf5b-4975-4cb9-a7f8-31cc5e52098a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121211) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:33:57.154156 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-2bbbe92d-c2d6-4efc-8b03-73017684abec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.820455 Sep 05 12:33:57.161828 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 318/638] 10.222.0.62 () {62 vars in 1188 bytes} [Mon Sep 5 12:33:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 05 12:33:57.170809 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e9fd25f9-4c21-40f4-963c-54a801912816 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:57.172392 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-e9fd25f9-4c21-40f4-963c-54a801912816 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:57.247497 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-e9fd25f9-4c21-40f4-963c-54a801912816 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:57.260680 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-e9fd25f9-4c21-40f4-963c-54a801912816 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:57.262422 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-e9fd25f9-4c21-40f4-963c-54a801912816 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:57.264043 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-e9fd25f9-4c21-40f4-963c-54a801912816 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1281 microversion: 2.20 time: 0.101094 Sep 05 12:33:57.266405 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 321/639] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:33:57 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1281 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:33:58.290524 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-617cab31-4596-46dc-be7b-81e30d4d0ff0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:58.291153 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-617cab31-4596-46dc-be7b-81e30d4d0ff0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:58.307262 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-617cab31-4596-46dc-be7b-81e30d4d0ff0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:58.307809 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-617cab31-4596-46dc-be7b-81e30d4d0ff0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:58.308204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-617cab31-4596-46dc-be7b-81e30d4d0ff0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:58.309127 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-617cab31-4596-46dc-be7b-81e30d4d0ff0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:58.309734 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-617cab31-4596-46dc-be7b-81e30d4d0ff0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:58.310332 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-617cab31-4596-46dc-be7b-81e30d4d0ff0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:58.378302 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-617cab31-4596-46dc-be7b-81e30d4d0ff0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:58.381899 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:58.387003 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-617cab31-4596-46dc-be7b-81e30d4d0ff0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:58.389748 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-617cab31-4596-46dc-be7b-81e30d4d0ff0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:58.389748 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-617cab31-4596-46dc-be7b-81e30d4d0ff0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1285 microversion: 2.20 time: 0.103061 Sep 05 12:33:58.390183 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 319/640] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:33:58 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:33:59.415796 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-c529971d-5c64-4003-819e-94a8bbbd5b7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:33:59.416461 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-c529971d-5c64-4003-819e-94a8bbbd5b7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:33:59.424505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c529971d-5c64-4003-819e-94a8bbbd5b7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:59.425044 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c529971d-5c64-4003-819e-94a8bbbd5b7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:59.425480 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c529971d-5c64-4003-819e-94a8bbbd5b7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:59.426188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c529971d-5c64-4003-819e-94a8bbbd5b7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:33:59.426639 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c529971d-5c64-4003-819e-94a8bbbd5b7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:33:59.427088 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c529971d-5c64-4003-819e-94a8bbbd5b7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:33:59.521125 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c529971d-5c64-4003-819e-94a8bbbd5b7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:59.530320 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c529971d-5c64-4003-819e-94a8bbbd5b7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:59.531935 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c529971d-5c64-4003-819e-94a8bbbd5b7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:33:59.533680 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-c529971d-5c64-4003-819e-94a8bbbd5b7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1333 microversion: 2.20 time: 0.121920 Sep 05 12:33:59.534450 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 322/641] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:33:59 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1333 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:34:00.563452 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0401849d-0d12-4a65-9155-62cde7baa6e8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:00.564248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0401849d-0d12-4a65-9155-62cde7baa6e8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:00.574864 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0401849d-0d12-4a65-9155-62cde7baa6e8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:00.575349 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0401849d-0d12-4a65-9155-62cde7baa6e8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:00.596445 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0401849d-0d12-4a65-9155-62cde7baa6e8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:00.597137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0401849d-0d12-4a65-9155-62cde7baa6e8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:00.597615 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0401849d-0d12-4a65-9155-62cde7baa6e8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:00.598054 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0401849d-0d12-4a65-9155-62cde7baa6e8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:00.690336 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0401849d-0d12-4a65-9155-62cde7baa6e8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:00.707195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0401849d-0d12-4a65-9155-62cde7baa6e8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:00.710029 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0401849d-0d12-4a65-9155-62cde7baa6e8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:00.723831 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0401849d-0d12-4a65-9155-62cde7baa6e8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1339 microversion: 2.20 time: 0.153428 Sep 05 12:34:00.723831 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 320/642] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:34:00 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1339 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:34:01.741552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-3629269a-c790-486c-b8b5-08d0c77442e0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:01.742937 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-3629269a-c790-486c-b8b5-08d0c77442e0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:01.756562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3629269a-c790-486c-b8b5-08d0c77442e0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:01.757422 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3629269a-c790-486c-b8b5-08d0c77442e0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:01.758027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3629269a-c790-486c-b8b5-08d0c77442e0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:01.760905 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3629269a-c790-486c-b8b5-08d0c77442e0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:01.761725 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3629269a-c790-486c-b8b5-08d0c77442e0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:01.763833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3629269a-c790-486c-b8b5-08d0c77442e0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:02.126797 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-3629269a-c790-486c-b8b5-08d0c77442e0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:02.140479 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-3629269a-c790-486c-b8b5-08d0c77442e0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:02.142193 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-3629269a-c790-486c-b8b5-08d0c77442e0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:02.143337 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-3629269a-c790-486c-b8b5-08d0c77442e0 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1407 microversion: 2.20 time: 0.405797 Sep 05 12:34:02.144479 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 323/643] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:34:01 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:34:02.197625 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-64a154d7-326e-4286-a771-a1b206fbde60 req-bf872828-0b6d-4c8f-8b5d-ab1e4c5436bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "407e87bb-faeb-4ba6-b6dc-e9b7a3690356", "tag": "3c7003e7-309e-4432-9c69-6cc1517fcb8d"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:02.209980 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-64a154d7-326e-4286-a771-a1b206fbde60 req-bf872828-0b6d-4c8f-8b5d-ab1e4c5436bc service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:02.210476 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-64a154d7-326e-4286-a771-a1b206fbde60 req-bf872828-0b6d-4c8f-8b5d-ab1e4c5436bc service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:02.210914 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-64a154d7-326e-4286-a771-a1b206fbde60 req-bf872828-0b6d-4c8f-8b5d-ab1e4c5436bc service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:02.235356 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-64a154d7-326e-4286-a771-a1b206fbde60 req-bf872828-0b6d-4c8f-8b5d-ab1e4c5436bc service nova] Creating event network-changed:3c7003e7-309e-4432-9c69-6cc1517fcb8d for instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 on hv-cinder-80135 Sep 05 12:34:02.245322 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-64a154d7-326e-4286-a771-a1b206fbde60 req-bf872828-0b6d-4c8f-8b5d-ab1e4c5436bc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053395 Sep 05 12:34:02.245934 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 321/644] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:03.173443 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-0dd15b1b-8773-4eb1-bca9-c7e6d40e25d5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:03.174810 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-0dd15b1b-8773-4eb1-bca9-c7e6d40e25d5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:03.211802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0dd15b1b-8773-4eb1-bca9-c7e6d40e25d5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:03.219510 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0dd15b1b-8773-4eb1-bca9-c7e6d40e25d5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:03.223019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0dd15b1b-8773-4eb1-bca9-c7e6d40e25d5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:03.223922 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0dd15b1b-8773-4eb1-bca9-c7e6d40e25d5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:03.224399 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0dd15b1b-8773-4eb1-bca9-c7e6d40e25d5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:03.224998 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0dd15b1b-8773-4eb1-bca9-c7e6d40e25d5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:03.478039 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-0dd15b1b-8773-4eb1-bca9-c7e6d40e25d5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:03.488233 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-0dd15b1b-8773-4eb1-bca9-c7e6d40e25d5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:03.489704 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-0dd15b1b-8773-4eb1-bca9-c7e6d40e25d5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:03.490840 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-0dd15b1b-8773-4eb1-bca9-c7e6d40e25d5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1407 microversion: 2.20 time: 0.324259 Sep 05 12:34:03.492393 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 324/645] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:34:03 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:34:04.523740 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-5de323d1-4eaf-47fe-be1b-2433028f173f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:04.525745 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-5de323d1-4eaf-47fe-be1b-2433028f173f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:04.534155 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5de323d1-4eaf-47fe-be1b-2433028f173f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:04.534652 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5de323d1-4eaf-47fe-be1b-2433028f173f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:04.535133 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5de323d1-4eaf-47fe-be1b-2433028f173f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:04.535900 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5de323d1-4eaf-47fe-be1b-2433028f173f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:04.536363 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5de323d1-4eaf-47fe-be1b-2433028f173f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:04.536796 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5de323d1-4eaf-47fe-be1b-2433028f173f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:04.710861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5de323d1-4eaf-47fe-be1b-2433028f173f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:04.719753 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5de323d1-4eaf-47fe-be1b-2433028f173f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:04.721651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5de323d1-4eaf-47fe-be1b-2433028f173f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:04.722833 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-5de323d1-4eaf-47fe-be1b-2433028f173f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1407 microversion: 2.20 time: 0.206544 Sep 05 12:34:04.723392 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 322/646] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:34:04 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:34:05.748959 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a2d58254-f3a6-4563-81a0-9e8b6f9f44f6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:05.749568 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a2d58254-f3a6-4563-81a0-9e8b6f9f44f6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:05.759513 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a2d58254-f3a6-4563-81a0-9e8b6f9f44f6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:05.760330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a2d58254-f3a6-4563-81a0-9e8b6f9f44f6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:05.760765 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a2d58254-f3a6-4563-81a0-9e8b6f9f44f6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:05.761611 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a2d58254-f3a6-4563-81a0-9e8b6f9f44f6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:05.762131 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a2d58254-f3a6-4563-81a0-9e8b6f9f44f6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:05.762550 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a2d58254-f3a6-4563-81a0-9e8b6f9f44f6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:05.967694 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a2d58254-f3a6-4563-81a0-9e8b6f9f44f6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:05.978630 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a2d58254-f3a6-4563-81a0-9e8b6f9f44f6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:05.980236 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a2d58254-f3a6-4563-81a0-9e8b6f9f44f6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:05.981598 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a2d58254-f3a6-4563-81a0-9e8b6f9f44f6 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1407 microversion: 2.20 time: 0.236834 Sep 05 12:34:05.982178 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 325/647] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:34:05 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:34:07.014133 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-cb241da0-2bb5-4bf3-9bcb-da596b104bbb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:07.015452 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-cb241da0-2bb5-4bf3-9bcb-da596b104bbb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:07.019375 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=2 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:07.020516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=6 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:07.028375 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cb241da0-2bb5-4bf3-9bcb-da596b104bbb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:07.030813 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cb241da0-2bb5-4bf3-9bcb-da596b104bbb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:07.031434 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cb241da0-2bb5-4bf3-9bcb-da596b104bbb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:07.032388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cb241da0-2bb5-4bf3-9bcb-da596b104bbb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:07.033007 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cb241da0-2bb5-4bf3-9bcb-da596b104bbb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:07.033607 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cb241da0-2bb5-4bf3-9bcb-da596b104bbb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:07.219937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-cb241da0-2bb5-4bf3-9bcb-da596b104bbb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:07.236042 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-cb241da0-2bb5-4bf3-9bcb-da596b104bbb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:07.237755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-cb241da0-2bb5-4bf3-9bcb-da596b104bbb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:07.240038 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-cb241da0-2bb5-4bf3-9bcb-da596b104bbb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1407 microversion: 2.20 time: 0.233129 Sep 05 12:34:07.242020 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 323/648] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:34:07 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:34:08.267152 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1845a7d1-2589-46ea-a36c-42348e790857 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:08.267975 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1845a7d1-2589-46ea-a36c-42348e790857 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:08.273884 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=6 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:08.276420 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1845a7d1-2589-46ea-a36c-42348e790857 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:08.277241 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1845a7d1-2589-46ea-a36c-42348e790857 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:08.277860 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1845a7d1-2589-46ea-a36c-42348e790857 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:08.278611 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1845a7d1-2589-46ea-a36c-42348e790857 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:08.279114 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1845a7d1-2589-46ea-a36c-42348e790857 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:08.279571 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1845a7d1-2589-46ea-a36c-42348e790857 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:08.444212 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1845a7d1-2589-46ea-a36c-42348e790857 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:08.464447 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1845a7d1-2589-46ea-a36c-42348e790857 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:08.465949 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1845a7d1-2589-46ea-a36c-42348e790857 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:08.467081 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1845a7d1-2589-46ea-a36c-42348e790857 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1407 microversion: 2.20 time: 0.204778 Sep 05 12:34:08.467672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 326/649] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:34:08 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:34:09.196202 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-a5b73da4-bde6-4091-adcb-0cc706fd80ef req-3f7c57ce-897b-4dbc-bce0-4caba23c8de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "407e87bb-faeb-4ba6-b6dc-e9b7a3690356", "name": "network-vif-plugged", "status": "completed", "tag": "3c7003e7-309e-4432-9c69-6cc1517fcb8d"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:09.212130 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-a5b73da4-bde6-4091-adcb-0cc706fd80ef req-3f7c57ce-897b-4dbc-bce0-4caba23c8de5 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:09.212922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-a5b73da4-bde6-4091-adcb-0cc706fd80ef req-3f7c57ce-897b-4dbc-bce0-4caba23c8de5 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:09.213543 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-a5b73da4-bde6-4091-adcb-0cc706fd80ef req-3f7c57ce-897b-4dbc-bce0-4caba23c8de5 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:09.226347 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-a5b73da4-bde6-4091-adcb-0cc706fd80ef req-3f7c57ce-897b-4dbc-bce0-4caba23c8de5 service nova] Creating event network-vif-plugged:3c7003e7-309e-4432-9c69-6cc1517fcb8d for instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 on hv-cinder-80135 Sep 05 12:34:09.233330 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-a5b73da4-bde6-4091-adcb-0cc706fd80ef req-3f7c57ce-897b-4dbc-bce0-4caba23c8de5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042054 Sep 05 12:34:09.234618 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 324/650] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:34:09.493161 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-8e327429-ea9e-4981-8220-d0c2ebe821ea tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:09.493698 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-8e327429-ea9e-4981-8220-d0c2ebe821ea tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:09.500801 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8e327429-ea9e-4981-8220-d0c2ebe821ea tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:09.501323 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8e327429-ea9e-4981-8220-d0c2ebe821ea tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:09.501784 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8e327429-ea9e-4981-8220-d0c2ebe821ea tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:09.502497 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8e327429-ea9e-4981-8220-d0c2ebe821ea tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:09.502941 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8e327429-ea9e-4981-8220-d0c2ebe821ea tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:09.503602 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8e327429-ea9e-4981-8220-d0c2ebe821ea tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:09.710641 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-8e327429-ea9e-4981-8220-d0c2ebe821ea tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:09.720150 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-8e327429-ea9e-4981-8220-d0c2ebe821ea tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:09.722820 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-8e327429-ea9e-4981-8220-d0c2ebe821ea tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:09.724404 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-8e327429-ea9e-4981-8220-d0c2ebe821ea tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1407 microversion: 2.20 time: 0.236068 Sep 05 12:34:09.725237 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 327/651] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:34:09 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:34:10.761818 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0c48333a-326e-4726-9b91-d2767d2dd84c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:10.765032 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0c48333a-326e-4726-9b91-d2767d2dd84c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:10.776591 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c48333a-326e-4726-9b91-d2767d2dd84c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:10.777962 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c48333a-326e-4726-9b91-d2767d2dd84c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:10.779851 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c48333a-326e-4726-9b91-d2767d2dd84c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:10.781425 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c48333a-326e-4726-9b91-d2767d2dd84c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:10.782393 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c48333a-326e-4726-9b91-d2767d2dd84c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:10.783218 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0c48333a-326e-4726-9b91-d2767d2dd84c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:11.150791 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0c48333a-326e-4726-9b91-d2767d2dd84c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:11.162039 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0c48333a-326e-4726-9b91-d2767d2dd84c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:11.163650 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0c48333a-326e-4726-9b91-d2767d2dd84c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:11.167172 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0c48333a-326e-4726-9b91-d2767d2dd84c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1407 microversion: 2.20 time: 0.413482 Sep 05 12:34:11.168136 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 325/652] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:34:10 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1407 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:34:12.195170 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d003d18d-15fc-47b4-9a16-ca7a1a1baa22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:12.195769 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d003d18d-15fc-47b4-9a16-ca7a1a1baa22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:12.198092 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:12.203797 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d003d18d-15fc-47b4-9a16-ca7a1a1baa22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:12.204344 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d003d18d-15fc-47b4-9a16-ca7a1a1baa22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:12.204871 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d003d18d-15fc-47b4-9a16-ca7a1a1baa22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:12.205573 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d003d18d-15fc-47b4-9a16-ca7a1a1baa22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:12.206088 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d003d18d-15fc-47b4-9a16-ca7a1a1baa22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:12.206510 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d003d18d-15fc-47b4-9a16-ca7a1a1baa22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:12.398956 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d003d18d-15fc-47b4-9a16-ca7a1a1baa22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:12.407937 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d003d18d-15fc-47b4-9a16-ca7a1a1baa22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:12.409375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d003d18d-15fc-47b4-9a16-ca7a1a1baa22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:12.410514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d003d18d-15fc-47b4-9a16-ca7a1a1baa22 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1599 microversion: 2.20 time: 0.219581 Sep 05 12:34:12.411066 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 328/653] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:34:12 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:34:12.434908 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-2cef1908-7032-4629-a995-1815be84489d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:12.435495 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-2cef1908-7032-4629-a995-1815be84489d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:12.441942 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2cef1908-7032-4629-a995-1815be84489d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:12.444062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2cef1908-7032-4629-a995-1815be84489d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:12.444062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2cef1908-7032-4629-a995-1815be84489d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:12.444062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2cef1908-7032-4629-a995-1815be84489d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:12.444062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2cef1908-7032-4629-a995-1815be84489d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:12.444435 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2cef1908-7032-4629-a995-1815be84489d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:12.547296 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-2cef1908-7032-4629-a995-1815be84489d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.116199 Sep 05 12:34:12.553243 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 326/654] 10.222.0.62 () {60 vars in 1316 bytes} [Mon Sep 5 12:34:12 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:34:13.967102 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-47a8c1f3-6485-4e76-b03c-615183914f7f req-408c3c37-b399-491e-a3a1-f48910632a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "407e87bb-faeb-4ba6-b6dc-e9b7a3690356", "tag": "3c7003e7-309e-4432-9c69-6cc1517fcb8d"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:13.979957 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-47a8c1f3-6485-4e76-b03c-615183914f7f req-408c3c37-b399-491e-a3a1-f48910632a47 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:13.980742 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-47a8c1f3-6485-4e76-b03c-615183914f7f req-408c3c37-b399-491e-a3a1-f48910632a47 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:13.981478 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-47a8c1f3-6485-4e76-b03c-615183914f7f req-408c3c37-b399-491e-a3a1-f48910632a47 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:13.998724 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-47a8c1f3-6485-4e76-b03c-615183914f7f req-408c3c37-b399-491e-a3a1-f48910632a47 service nova] Creating event network-changed:3c7003e7-309e-4432-9c69-6cc1517fcb8d for instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 on hv-cinder-80135 Sep 05 12:34:14.004590 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-47a8c1f3-6485-4e76-b03c-615183914f7f req-408c3c37-b399-491e-a3a1-f48910632a47 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041243 Sep 05 12:34:14.010642 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 329/655] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:16.676051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-191f313b-5f07-4545-b146-63f47c445278 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Action: 'create', calling method: .version_select at 0x7fe712804a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1102826235", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJuJER9dnbU+TUbi69zy5pk/htT7g88b1PAoKMH//aZINfFA85GZ0T8a+y4wNbu4hj2Du7yu2A8uLkEGKXp30KNxVMB9igdYZAg32RCEHVqBifBTgAagkRAm1hZPRlX2Q=="}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:16.681805 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:16.703928 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-191f313b-5f07-4545-b146-63f47c445278 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Getting quotas for project 6b86bf1c78d74ceaaff6ead90a70526f. Resources: {'key_pairs'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:34:16.703928 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-191f313b-5f07-4545-b146-63f47c445278 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Getting quotas for user 087ceea13e3747f49096b42d9d5c1c86 and project 6b86bf1c78d74ceaaff6ead90a70526f. Resources: {'key_pairs'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:34:16.715433 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR oslo.messaging._drivers.impl_rabbit [None req-191f313b-5f07-4545-b146-63f47c445278 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [a80ebc14-9bc0-4280-85d6-ac5ccdf4c268] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 05 12:34:17.723888 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO oslo.messaging._drivers.impl_rabbit [None req-191f313b-5f07-4545-b146-63f47c445278 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [a80ebc14-9bc0-4280-85d6-ac5ccdf4c268] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 41094. Sep 05 12:34:17.821369 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-191f313b-5f07-4545-b146-63f47c445278 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.149165 Sep 05 12:34:17.822098 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 327/656] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Sep 5 12:34:16 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:17.933575 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-c1afd97e-18b9-4844-81a7-ef345fbf1e21 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-694721308", "imageRef": "909fee37-5718-4625-9c72-5a4330023e09", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1102826235", "networks": [{"uuid": "62fa3af2-b3d1-49d5-9125-58895bfbed57"}]}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:17.987962 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.network.neutron [None req-c1afd97e-18b9-4844-81a7-ef345fbf1e21 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] validate_networks() for [('62fa3af2-b3d1-49d5-9125-58895bfbed57', None, None, None, None, None)] {{(pid=121210) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:34:18.370625 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-c1afd97e-18b9-4844-81a7-ef345fbf1e21 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Flavor limits 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:34:18.371044 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-c1afd97e-18b9-4844-81a7-ef345fbf1e21 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Image limits 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:34:18.371525 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-c1afd97e-18b9-4844-81a7-ef345fbf1e21 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Flavor pref 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:34:18.371955 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-c1afd97e-18b9-4844-81a7-ef345fbf1e21 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Image pref 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:34:18.372359 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-c1afd97e-18b9-4844-81a7-ef345fbf1e21 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:34:18.381303 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c1afd97e-18b9-4844-81a7-ef345fbf1e21 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:18.381789 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c1afd97e-18b9-4844-81a7-ef345fbf1e21 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:18.382218 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c1afd97e-18b9-4844-81a7-ef345fbf1e21 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:18.382934 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c1afd97e-18b9-4844-81a7-ef345fbf1e21 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:18.383386 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c1afd97e-18b9-4844-81a7-ef345fbf1e21 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:18.383833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c1afd97e-18b9-4844-81a7-ef345fbf1e21 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:18.391157 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=95 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:18.401926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-c1afd97e-18b9-4844-81a7-ef345fbf1e21 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Getting quotas for project 6b86bf1c78d74ceaaff6ead90a70526f. Resources: {'ram', 'instances', 'cores'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:34:18.406578 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-c1afd97e-18b9-4844-81a7-ef345fbf1e21 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Getting quotas for user 087ceea13e3747f49096b42d9d5c1c86 and project 6b86bf1c78d74ceaaff6ead90a70526f. Resources: {'ram', 'instances', 'cores'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:34:18.417704 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-c1afd97e-18b9-4844-81a7-ef345fbf1e21 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Going to run 1 instances... {{(pid=121210) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:34:18.420107 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-c1afd97e-18b9-4844-81a7-ef345fbf1e21 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='909fee37-5718-4625-9c72-5a4330023e09',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:34:18.537182 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-c1afd97e-18b9-4844-81a7-ef345fbf1e21 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608034 Sep 05 12:34:18.537769 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 330/657] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Sep 5 12:34:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:34:18.552373 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-95b72939-69ee-4556-b524-381d1e733571 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:18.553034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-95b72939-69ee-4556-b524-381d1e733571 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:18.615217 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-95b72939-69ee-4556-b524-381d1e733571 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:18.622463 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-95b72939-69ee-4556-b524-381d1e733571 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1258 microversion: 2.1 time: 0.077054 Sep 05 12:34:18.623946 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 328/658] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:18 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:19.647060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-fa4a494e-ab1e-4c8a-9a9e-09ac58cfc1f1 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:19.647697 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-fa4a494e-ab1e-4c8a-9a9e-09ac58cfc1f1 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:19.702905 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-fa4a494e-ab1e-4c8a-9a9e-09ac58cfc1f1 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:19.710312 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-fa4a494e-ab1e-4c8a-9a9e-09ac58cfc1f1 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1258 microversion: 2.1 time: 0.067766 Sep 05 12:34:19.710886 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 331/659] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:19 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:20.735965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-38573217-0dbb-4719-9fe3-72b858213363 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:20.736515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-38573217-0dbb-4719-9fe3-72b858213363 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:20.743462 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-38573217-0dbb-4719-9fe3-72b858213363 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:20.744136 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-38573217-0dbb-4719-9fe3-72b858213363 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:20.744575 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-38573217-0dbb-4719-9fe3-72b858213363 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:20.745304 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-38573217-0dbb-4719-9fe3-72b858213363 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:20.745765 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-38573217-0dbb-4719-9fe3-72b858213363 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:20.746191 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-38573217-0dbb-4719-9fe3-72b858213363 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:20.811257 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-38573217-0dbb-4719-9fe3-72b858213363 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:20.819630 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-38573217-0dbb-4719-9fe3-72b858213363 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1254 microversion: 2.1 time: 0.088762 Sep 05 12:34:20.820421 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 329/660] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:20 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1254 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:21.842723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a4653b75-0b66-4ba9-882f-133d29275be7 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:21.843361 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a4653b75-0b66-4ba9-882f-133d29275be7 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:21.850299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a4653b75-0b66-4ba9-882f-133d29275be7 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:21.850784 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a4653b75-0b66-4ba9-882f-133d29275be7 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:21.851248 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a4653b75-0b66-4ba9-882f-133d29275be7 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:21.851977 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a4653b75-0b66-4ba9-882f-133d29275be7 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:21.852437 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a4653b75-0b66-4ba9-882f-133d29275be7 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:21.854349 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a4653b75-0b66-4ba9-882f-133d29275be7 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:21.916194 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a4653b75-0b66-4ba9-882f-133d29275be7 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:21.924435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a4653b75-0b66-4ba9-882f-133d29275be7 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1310 microversion: 2.1 time: 0.085576 Sep 05 12:34:21.924993 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 332/661] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:21 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:22.949262 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-70a0120b-d66c-4eae-bb71-28f185013063 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:22.949262 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-70a0120b-d66c-4eae-bb71-28f185013063 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:22.959833 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-70a0120b-d66c-4eae-bb71-28f185013063 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:22.960401 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-70a0120b-d66c-4eae-bb71-28f185013063 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:22.960829 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-70a0120b-d66c-4eae-bb71-28f185013063 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:22.961529 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-70a0120b-d66c-4eae-bb71-28f185013063 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:22.961973 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-70a0120b-d66c-4eae-bb71-28f185013063 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:22.962389 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-70a0120b-d66c-4eae-bb71-28f185013063 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:23.036784 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-70a0120b-d66c-4eae-bb71-28f185013063 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:23.044804 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-70a0120b-d66c-4eae-bb71-28f185013063 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1316 microversion: 2.1 time: 0.100915 Sep 05 12:34:23.045392 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 330/662] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:22 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1316 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:24.070570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d8efbc86-59cf-4f90-b1cf-07b2812d3258 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:24.071171 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d8efbc86-59cf-4f90-b1cf-07b2812d3258 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:24.077686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d8efbc86-59cf-4f90-b1cf-07b2812d3258 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:24.084052 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d8efbc86-59cf-4f90-b1cf-07b2812d3258 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:24.084052 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d8efbc86-59cf-4f90-b1cf-07b2812d3258 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:24.084052 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d8efbc86-59cf-4f90-b1cf-07b2812d3258 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:24.084052 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d8efbc86-59cf-4f90-b1cf-07b2812d3258 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:24.084412 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d8efbc86-59cf-4f90-b1cf-07b2812d3258 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:24.221416 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d8efbc86-59cf-4f90-b1cf-07b2812d3258 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:24.229790 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d8efbc86-59cf-4f90-b1cf-07b2812d3258 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1358 microversion: 2.1 time: 0.163062 Sep 05 12:34:24.230444 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 333/663] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:24 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:25.252989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3a823726-8f55-4362-8181-b91d6a5cddcd tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:25.253589 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-3a823726-8f55-4362-8181-b91d6a5cddcd tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:25.259958 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3a823726-8f55-4362-8181-b91d6a5cddcd tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:25.260434 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3a823726-8f55-4362-8181-b91d6a5cddcd tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:25.260863 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3a823726-8f55-4362-8181-b91d6a5cddcd tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:25.261542 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3a823726-8f55-4362-8181-b91d6a5cddcd tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:25.261988 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3a823726-8f55-4362-8181-b91d6a5cddcd tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:25.262438 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3a823726-8f55-4362-8181-b91d6a5cddcd tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:25.400591 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3a823726-8f55-4362-8181-b91d6a5cddcd tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:25.408792 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3a823726-8f55-4362-8181-b91d6a5cddcd tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1358 microversion: 2.1 time: 0.159603 Sep 05 12:34:25.409367 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 331/664] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:25 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:25.912771 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-41283081-741e-44b5-8f8c-33173d46d3bf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:25.913274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-41283081-741e-44b5-8f8c-33173d46d3bf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:25.919562 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-41283081-741e-44b5-8f8c-33173d46d3bf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:25.919784 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-8c42f930-7d80-4370-8703-550e33d5ce5a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:25.920462 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-41283081-741e-44b5-8f8c-33173d46d3bf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:25.920640 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-8c42f930-7d80-4370-8703-550e33d5ce5a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:25.920807 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-41283081-741e-44b5-8f8c-33173d46d3bf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:25.921168 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-41283081-741e-44b5-8f8c-33173d46d3bf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:25.921763 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-41283081-741e-44b5-8f8c-33173d46d3bf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:25.922040 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-41283081-741e-44b5-8f8c-33173d46d3bf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:25.927915 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c42f930-7d80-4370-8703-550e33d5ce5a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:25.928430 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c42f930-7d80-4370-8703-550e33d5ce5a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:25.928857 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c42f930-7d80-4370-8703-550e33d5ce5a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:25.929733 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c42f930-7d80-4370-8703-550e33d5ce5a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:25.930038 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c42f930-7d80-4370-8703-550e33d5ce5a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:25.930463 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c42f930-7d80-4370-8703-550e33d5ce5a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:25.959259 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-8c42f930-7d80-4370-8703-550e33d5ce5a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76/ips" status: 200 len: 150 microversion: 2.1 time: 0.170859 Sep 05 12:34:25.959259 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 334/665] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Sep 5 12:34:25 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76/ips => generated 150 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:34:26.035472 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.objects.instance [None req-41283081-741e-44b5-8f8c-33173d46d3bf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lazy-loading 'services' on Instance uuid c86e0b82-f349-40c6-986b-359cb36a9862 {{(pid=121211) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:34:26.312171 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-41283081-741e-44b5-8f8c-33173d46d3bf tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments/e2294d56-f5d6-43da-b238-8fdb69187179" status: 202 len: 0 microversion: 2.1 time: 0.405314 Sep 05 12:34:26.313553 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 332/666] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Sep 5 12:34:25 2022] DELETE /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments/e2294d56-f5d6-43da-b238-8fdb69187179 => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:34:26.322530 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-f7435f66-6185-46e0-988f-e984c141b730 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:26.324907 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-f7435f66-6185-46e0-988f-e984c141b730 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:26.331761 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f7435f66-6185-46e0-988f-e984c141b730 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:26.332258 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f7435f66-6185-46e0-988f-e984c141b730 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:26.332696 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f7435f66-6185-46e0-988f-e984c141b730 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:26.333400 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f7435f66-6185-46e0-988f-e984c141b730 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:26.333856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f7435f66-6185-46e0-988f-e984c141b730 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:26.334277 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f7435f66-6185-46e0-988f-e984c141b730 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:26.370712 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-f7435f66-6185-46e0-988f-e984c141b730 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052244 Sep 05 12:34:26.372063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 335/667] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:34:26 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:26.433296 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ec54baa4-5d29-4d4f-9f2b-da428c442856 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:26.434005 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ec54baa4-5d29-4d4f-9f2b-da428c442856 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:26.440604 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ec54baa4-5d29-4d4f-9f2b-da428c442856 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:26.441095 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ec54baa4-5d29-4d4f-9f2b-da428c442856 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:26.441615 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ec54baa4-5d29-4d4f-9f2b-da428c442856 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:26.442325 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ec54baa4-5d29-4d4f-9f2b-da428c442856 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:26.442784 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ec54baa4-5d29-4d4f-9f2b-da428c442856 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:26.443212 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ec54baa4-5d29-4d4f-9f2b-da428c442856 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:26.585862 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ec54baa4-5d29-4d4f-9f2b-da428c442856 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:26.595306 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ec54baa4-5d29-4d4f-9f2b-da428c442856 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1358 microversion: 2.1 time: 0.165621 Sep 05 12:34:26.595914 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 333/668] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:26 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:27.497491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-2eeb2766-5474-4e33-9d2d-94a4710acbed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:27.499310 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-2eeb2766-5474-4e33-9d2d-94a4710acbed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:27.506495 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2eeb2766-5474-4e33-9d2d-94a4710acbed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:27.507181 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2eeb2766-5474-4e33-9d2d-94a4710acbed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:27.507181 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2eeb2766-5474-4e33-9d2d-94a4710acbed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:27.507181 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2eeb2766-5474-4e33-9d2d-94a4710acbed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:27.507181 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2eeb2766-5474-4e33-9d2d-94a4710acbed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:27.514470 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2eeb2766-5474-4e33-9d2d-94a4710acbed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:27.543432 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-2eeb2766-5474-4e33-9d2d-94a4710acbed tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163282 Sep 05 12:34:27.544342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 336/669] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:34:27 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:27.620244 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-dde310f1-cc33-4c50-93a4-a74957746369 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:27.620860 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-dde310f1-cc33-4c50-93a4-a74957746369 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:27.627871 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-dde310f1-cc33-4c50-93a4-a74957746369 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:27.628359 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-dde310f1-cc33-4c50-93a4-a74957746369 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:27.628792 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-dde310f1-cc33-4c50-93a4-a74957746369 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:27.629495 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-dde310f1-cc33-4c50-93a4-a74957746369 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:27.629951 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-dde310f1-cc33-4c50-93a4-a74957746369 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:27.630372 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-dde310f1-cc33-4c50-93a4-a74957746369 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:27.762986 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-bb90e26b-30a6-4ffc-8586-0f7e92095ec4 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bc25d85-cf25-4967-8810-d181cbb9aeee"}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:27.765387 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-bb90e26b-30a6-4ffc-8586-0f7e92095ec4 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:27.772871 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bb90e26b-30a6-4ffc-8586-0f7e92095ec4 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:27.773362 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bb90e26b-30a6-4ffc-8586-0f7e92095ec4 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:27.776401 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bb90e26b-30a6-4ffc-8586-0f7e92095ec4 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:27.777152 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bb90e26b-30a6-4ffc-8586-0f7e92095ec4 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:27.777898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bb90e26b-30a6-4ffc-8586-0f7e92095ec4 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:27.778326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bb90e26b-30a6-4ffc-8586-0f7e92095ec4 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:27.791225 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-dde310f1-cc33-4c50-93a4-a74957746369 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:27.799769 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-dde310f1-cc33-4c50-93a4-a74957746369 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1358 microversion: 2.1 time: 0.183412 Sep 05 12:34:27.800350 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 334/670] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:27 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:28.391778 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=2 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:28.558096 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-824b482b-e936-4587-a494-da5bf7a21d95 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:28.560692 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-824b482b-e936-4587-a494-da5bf7a21d95 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:28.570147 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-824b482b-e936-4587-a494-da5bf7a21d95 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:28.570741 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-824b482b-e936-4587-a494-da5bf7a21d95 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:28.571304 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-824b482b-e936-4587-a494-da5bf7a21d95 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:28.572295 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-824b482b-e936-4587-a494-da5bf7a21d95 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:28.572701 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-824b482b-e936-4587-a494-da5bf7a21d95 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:28.573424 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-824b482b-e936-4587-a494-da5bf7a21d95 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:28.607223 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-824b482b-e936-4587-a494-da5bf7a21d95 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054720 Sep 05 12:34:28.610710 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 335/671] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:34:28 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:28.823127 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7e9a27cd-30a3-4212-8824-f69f2a5cab6c tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:28.823790 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-7e9a27cd-30a3-4212-8824-f69f2a5cab6c tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:28.825881 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=6 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:28.832059 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7e9a27cd-30a3-4212-8824-f69f2a5cab6c tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:28.832545 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7e9a27cd-30a3-4212-8824-f69f2a5cab6c tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:28.832979 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7e9a27cd-30a3-4212-8824-f69f2a5cab6c tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:28.833682 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7e9a27cd-30a3-4212-8824-f69f2a5cab6c tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:28.834138 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7e9a27cd-30a3-4212-8824-f69f2a5cab6c tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:28.834569 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7e9a27cd-30a3-4212-8824-f69f2a5cab6c tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:28.973883 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-7e9a27cd-30a3-4212-8824-f69f2a5cab6c tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:28.984230 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-7e9a27cd-30a3-4212-8824-f69f2a5cab6c tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1358 microversion: 2.1 time: 0.164652 Sep 05 12:34:28.995793 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 336/672] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:28 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:34:29.624716 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4a687a34-6e02-4956-8605-7a77ac57934c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:29.627751 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4a687a34-6e02-4956-8605-7a77ac57934c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:29.637103 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a687a34-6e02-4956-8605-7a77ac57934c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:29.637599 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a687a34-6e02-4956-8605-7a77ac57934c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:29.638049 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a687a34-6e02-4956-8605-7a77ac57934c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:29.638767 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a687a34-6e02-4956-8605-7a77ac57934c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:29.639222 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a687a34-6e02-4956-8605-7a77ac57934c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:29.639677 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4a687a34-6e02-4956-8605-7a77ac57934c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:29.669798 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4a687a34-6e02-4956-8605-7a77ac57934c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052866 Sep 05 12:34:29.670369 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 337/673] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:34:29 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:29.711749 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=8 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:30.009958 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-375f2278-9c52-4d26-88a3-7d4e3b99537b tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:30.010537 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-375f2278-9c52-4d26-88a3-7d4e3b99537b tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:30.017113 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-375f2278-9c52-4d26-88a3-7d4e3b99537b tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:30.017598 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-375f2278-9c52-4d26-88a3-7d4e3b99537b tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:30.018033 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-375f2278-9c52-4d26-88a3-7d4e3b99537b tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:30.018733 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-375f2278-9c52-4d26-88a3-7d4e3b99537b tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:30.019192 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-375f2278-9c52-4d26-88a3-7d4e3b99537b tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:30.019627 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-375f2278-9c52-4d26-88a3-7d4e3b99537b tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:30.155084 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-375f2278-9c52-4d26-88a3-7d4e3b99537b tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:30.164041 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-375f2278-9c52-4d26-88a3-7d4e3b99537b tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1358 microversion: 2.1 time: 0.157984 Sep 05 12:34:30.164919 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 338/674] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:30 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:34:30.682513 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ede13808-5b11-4d2a-96b5-0060aa158f95 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:30.684816 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ede13808-5b11-4d2a-96b5-0060aa158f95 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:30.691132 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ede13808-5b11-4d2a-96b5-0060aa158f95 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:30.691797 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ede13808-5b11-4d2a-96b5-0060aa158f95 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:30.692229 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ede13808-5b11-4d2a-96b5-0060aa158f95 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:30.699774 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ede13808-5b11-4d2a-96b5-0060aa158f95 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:30.700546 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ede13808-5b11-4d2a-96b5-0060aa158f95 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:30.701002 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ede13808-5b11-4d2a-96b5-0060aa158f95 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:30.705943 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:30.733410 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ede13808-5b11-4d2a-96b5-0060aa158f95 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054806 Sep 05 12:34:30.733987 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 339/675] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:34:30 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:34:31.187756 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-213df050-37d2-4116-a59f-822a3db13896 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:31.188629 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-213df050-37d2-4116-a59f-822a3db13896 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:31.196585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-213df050-37d2-4116-a59f-822a3db13896 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:31.197082 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-213df050-37d2-4116-a59f-822a3db13896 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:31.197515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-213df050-37d2-4116-a59f-822a3db13896 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:31.198252 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-213df050-37d2-4116-a59f-822a3db13896 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:31.198709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-213df050-37d2-4116-a59f-822a3db13896 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:31.199132 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-213df050-37d2-4116-a59f-822a3db13896 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:31.366776 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-213df050-37d2-4116-a59f-822a3db13896 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:31.377206 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-213df050-37d2-4116-a59f-822a3db13896 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1358 microversion: 2.1 time: 0.193381 Sep 05 12:34:31.377853 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 340/676] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:31 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:31.746658 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d410c530-54b4-42ab-b702-c9b1ba03a99a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:31.748977 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d410c530-54b4-42ab-b702-c9b1ba03a99a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:31.756158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d410c530-54b4-42ab-b702-c9b1ba03a99a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:31.756643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d410c530-54b4-42ab-b702-c9b1ba03a99a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:31.757076 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d410c530-54b4-42ab-b702-c9b1ba03a99a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:31.757795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d410c530-54b4-42ab-b702-c9b1ba03a99a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:31.758229 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d410c530-54b4-42ab-b702-c9b1ba03a99a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:31.758650 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d410c530-54b4-42ab-b702-c9b1ba03a99a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:31.791250 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d410c530-54b4-42ab-b702-c9b1ba03a99a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048601 Sep 05 12:34:31.792324 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 341/677] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:34:31 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:34:32.401537 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-eb296bdc-c8d3-4807-9d09-a0a89f8d0ac8 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:32.402429 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-eb296bdc-c8d3-4807-9d09-a0a89f8d0ac8 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:32.409586 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-eb296bdc-c8d3-4807-9d09-a0a89f8d0ac8 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:32.410099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-eb296bdc-c8d3-4807-9d09-a0a89f8d0ac8 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:32.410527 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-eb296bdc-c8d3-4807-9d09-a0a89f8d0ac8 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:32.411313 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-eb296bdc-c8d3-4807-9d09-a0a89f8d0ac8 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:32.411798 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-eb296bdc-c8d3-4807-9d09-a0a89f8d0ac8 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:32.412218 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-eb296bdc-c8d3-4807-9d09-a0a89f8d0ac8 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:32.564113 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-eb296bdc-c8d3-4807-9d09-a0a89f8d0ac8 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:32.569530 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-eb296bdc-c8d3-4807-9d09-a0a89f8d0ac8 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1358 microversion: 2.1 time: 0.172406 Sep 05 12:34:32.570110 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 342/678] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:32 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:34:32.804386 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3e44498e-a403-4538-8d43-055758789a6e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:32.806585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-3e44498e-a403-4538-8d43-055758789a6e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:32.812769 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3e44498e-a403-4538-8d43-055758789a6e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:32.813807 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3e44498e-a403-4538-8d43-055758789a6e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:32.814244 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3e44498e-a403-4538-8d43-055758789a6e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:32.814954 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3e44498e-a403-4538-8d43-055758789a6e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:32.815444 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3e44498e-a403-4538-8d43-055758789a6e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:32.816057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3e44498e-a403-4538-8d43-055758789a6e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:32.848781 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3e44498e-a403-4538-8d43-055758789a6e tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048553 Sep 05 12:34:32.849365 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 343/679] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:34:32 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:34:33.592449 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e0cc0b59-2443-457d-a464-3426a88202da tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:33.593133 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e0cc0b59-2443-457d-a464-3426a88202da tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:33.600061 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e0cc0b59-2443-457d-a464-3426a88202da tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:33.600543 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e0cc0b59-2443-457d-a464-3426a88202da tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:33.600977 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e0cc0b59-2443-457d-a464-3426a88202da tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:33.601703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e0cc0b59-2443-457d-a464-3426a88202da tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:33.602159 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e0cc0b59-2443-457d-a464-3426a88202da tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:33.602580 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e0cc0b59-2443-457d-a464-3426a88202da tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:33.738887 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e0cc0b59-2443-457d-a464-3426a88202da tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:33.747755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e0cc0b59-2443-457d-a464-3426a88202da tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1358 microversion: 2.1 time: 0.159263 Sep 05 12:34:33.748547 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 344/680] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:33 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:33.861208 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0ccef857-e9f0-4ca8-a6be-264b1a1458fb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:33.863651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0ccef857-e9f0-4ca8-a6be-264b1a1458fb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:33.869819 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0ccef857-e9f0-4ca8-a6be-264b1a1458fb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:33.873048 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0ccef857-e9f0-4ca8-a6be-264b1a1458fb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:33.873048 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0ccef857-e9f0-4ca8-a6be-264b1a1458fb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:33.873048 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0ccef857-e9f0-4ca8-a6be-264b1a1458fb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:33.873048 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0ccef857-e9f0-4ca8-a6be-264b1a1458fb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:33.873448 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0ccef857-e9f0-4ca8-a6be-264b1a1458fb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:33.904449 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0ccef857-e9f0-4ca8-a6be-264b1a1458fb tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047612 Sep 05 12:34:33.905233 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 345/681] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:34:33 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:34:34.771445 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-66382405-a8ed-4145-9021-f3c3439298ee tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:34.772200 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-66382405-a8ed-4145-9021-f3c3439298ee tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:34.778715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-66382405-a8ed-4145-9021-f3c3439298ee tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:34.779198 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-66382405-a8ed-4145-9021-f3c3439298ee tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:34.779664 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-66382405-a8ed-4145-9021-f3c3439298ee tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:34.780365 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-66382405-a8ed-4145-9021-f3c3439298ee tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:34.780822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-66382405-a8ed-4145-9021-f3c3439298ee tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:34.781246 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-66382405-a8ed-4145-9021-f3c3439298ee tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:34.924849 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-66382405-a8ed-4145-9021-f3c3439298ee tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:34.932790 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-66382405-a8ed-4145-9021-f3c3439298ee tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1358 microversion: 2.1 time: 0.165151 Sep 05 12:34:34.933364 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 346/682] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:34 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:34:34.937937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-5a96e5bf-05b4-47ba-8639-717da5e4375f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:34.940642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-5a96e5bf-05b4-47ba-8639-717da5e4375f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:34.946445 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5a96e5bf-05b4-47ba-8639-717da5e4375f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:34.946917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5a96e5bf-05b4-47ba-8639-717da5e4375f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:34.947347 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5a96e5bf-05b4-47ba-8639-717da5e4375f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:34.948056 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5a96e5bf-05b4-47ba-8639-717da5e4375f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:34.948507 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5a96e5bf-05b4-47ba-8639-717da5e4375f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:34.948927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5a96e5bf-05b4-47ba-8639-717da5e4375f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:34.984407 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-5a96e5bf-05b4-47ba-8639-717da5e4375f tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049957 Sep 05 12:34:34.985016 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 347/683] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:34:34 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:35.575284 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-e43a0632-c9e3-4932-a6e9-79ff76460af1 req-9657b3d0-3a0d-40e7-9da9-82de93d53b47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8aa06a-9ac0-41d2-93ba-ae42895d418f", "tag": "484ab154-1eb7-4f51-b8a6-351d2c0646e4"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:35.586383 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-e43a0632-c9e3-4932-a6e9-79ff76460af1 req-9657b3d0-3a0d-40e7-9da9-82de93d53b47 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:35.587075 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-e43a0632-c9e3-4932-a6e9-79ff76460af1 req-9657b3d0-3a0d-40e7-9da9-82de93d53b47 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:35.587723 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-e43a0632-c9e3-4932-a6e9-79ff76460af1 req-9657b3d0-3a0d-40e7-9da9-82de93d53b47 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:35.605248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-e43a0632-c9e3-4932-a6e9-79ff76460af1 req-9657b3d0-3a0d-40e7-9da9-82de93d53b47 service nova] Creating event network-changed:484ab154-1eb7-4f51-b8a6-351d2c0646e4 for instance 7a8aa06a-9ac0-41d2-93ba-ae42895d418f on hv-cinder-80135 Sep 05 12:34:35.613951 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-e43a0632-c9e3-4932-a6e9-79ff76460af1 req-9657b3d0-3a0d-40e7-9da9-82de93d53b47 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042614 Sep 05 12:34:35.615165 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 348/684] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:34:35.643719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-bb90e26b-30a6-4ffc-8586-0f7e92095ec4 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "POST /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.884216 Sep 05 12:34:35.647784 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 337/685] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Sep 5 12:34:27 2022] POST /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76/os-volume_attachments => generated 194 bytes in 7887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:34:35.961231 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-631aeb41-b749-4584-8c69-68471f8f724a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:35.962029 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-631aeb41-b749-4584-8c69-68471f8f724a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:35.968662 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-631aeb41-b749-4584-8c69-68471f8f724a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:35.969151 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-631aeb41-b749-4584-8c69-68471f8f724a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:35.969585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-631aeb41-b749-4584-8c69-68471f8f724a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:35.970294 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-631aeb41-b749-4584-8c69-68471f8f724a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:35.970748 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-631aeb41-b749-4584-8c69-68471f8f724a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:35.971175 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-631aeb41-b749-4584-8c69-68471f8f724a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:35.998490 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-11a8744c-c03e-4021-8e20-f7757431381c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:36.001618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-11a8744c-c03e-4021-8e20-f7757431381c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:36.008692 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-11a8744c-c03e-4021-8e20-f7757431381c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:36.009195 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-11a8744c-c03e-4021-8e20-f7757431381c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:36.009671 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-11a8744c-c03e-4021-8e20-f7757431381c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:36.010387 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-11a8744c-c03e-4021-8e20-f7757431381c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:36.011515 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-11a8744c-c03e-4021-8e20-f7757431381c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:36.011985 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-11a8744c-c03e-4021-8e20-f7757431381c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:36.047739 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-11a8744c-c03e-4021-8e20-f7757431381c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053586 Sep 05 12:34:36.050727 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 338/686] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:34:35 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:34:36.208967 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-631aeb41-b749-4584-8c69-68471f8f724a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:36.216771 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-631aeb41-b749-4584-8c69-68471f8f724a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1358 microversion: 2.1 time: 0.260305 Sep 05 12:34:36.217492 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 349/687] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:35 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:37.060391 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ae354e11-3ff5-4797-94bc-2ebd92d9f559 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:37.062576 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-ae354e11-3ff5-4797-94bc-2ebd92d9f559 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:37.069281 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ae354e11-3ff5-4797-94bc-2ebd92d9f559 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:37.069763 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ae354e11-3ff5-4797-94bc-2ebd92d9f559 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:37.070196 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ae354e11-3ff5-4797-94bc-2ebd92d9f559 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:37.070894 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ae354e11-3ff5-4797-94bc-2ebd92d9f559 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:37.071345 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ae354e11-3ff5-4797-94bc-2ebd92d9f559 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:37.071795 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ae354e11-3ff5-4797-94bc-2ebd92d9f559 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:37.102690 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-ae354e11-3ff5-4797-94bc-2ebd92d9f559 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046239 Sep 05 12:34:37.103270 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 339/688] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:34:37 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 12:34:37.183385 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-5a15d3c8-c2a8-44d5-acc1-0fcf4f697023 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:37.183997 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-5a15d3c8-c2a8-44d5-acc1-0fcf4f697023 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:37.190589 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5a15d3c8-c2a8-44d5-acc1-0fcf4f697023 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:37.191074 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5a15d3c8-c2a8-44d5-acc1-0fcf4f697023 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:37.191509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5a15d3c8-c2a8-44d5-acc1-0fcf4f697023 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:37.192229 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5a15d3c8-c2a8-44d5-acc1-0fcf4f697023 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:37.192679 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5a15d3c8-c2a8-44d5-acc1-0fcf4f697023 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:37.193100 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5a15d3c8-c2a8-44d5-acc1-0fcf4f697023 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:37.218647 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-5a15d3c8-c2a8-44d5-acc1-0fcf4f697023 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Going to try to terminate instance {{(pid=121211) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:34:37.240450 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-bb99e2da-77e6-49f4-b08c-18acddf56e51 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:37.241063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-bb99e2da-77e6-49f4-b08c-18acddf56e51 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:37.247154 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bb99e2da-77e6-49f4-b08c-18acddf56e51 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:37.247657 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bb99e2da-77e6-49f4-b08c-18acddf56e51 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:37.248095 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bb99e2da-77e6-49f4-b08c-18acddf56e51 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:37.248840 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bb99e2da-77e6-49f4-b08c-18acddf56e51 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:37.249257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bb99e2da-77e6-49f4-b08c-18acddf56e51 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:37.249682 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bb99e2da-77e6-49f4-b08c-18acddf56e51 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:37.383096 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-bb99e2da-77e6-49f4-b08c-18acddf56e51 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:37.393958 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-bb99e2da-77e6-49f4-b08c-18acddf56e51 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1358 microversion: 2.1 time: 0.155269 Sep 05 12:34:37.393958 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 340/689] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:37 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:34:37.569185 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-5a15d3c8-c2a8-44d5-acc1-0fcf4f697023 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 204 len: 0 microversion: 2.1 time: 0.389343 Sep 05 12:34:37.569910 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 350/690] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:34:37 2022] DELETE /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:34:37.578239 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-9ad7aea8-17e9-4da3-b1cc-e14fcdea15a6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:37.578853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-9ad7aea8-17e9-4da3-b1cc-e14fcdea15a6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:37.588676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9ad7aea8-17e9-4da3-b1cc-e14fcdea15a6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:37.588676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9ad7aea8-17e9-4da3-b1cc-e14fcdea15a6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:37.588676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9ad7aea8-17e9-4da3-b1cc-e14fcdea15a6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:37.588676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9ad7aea8-17e9-4da3-b1cc-e14fcdea15a6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:37.589128 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9ad7aea8-17e9-4da3-b1cc-e14fcdea15a6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:37.589128 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9ad7aea8-17e9-4da3-b1cc-e14fcdea15a6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:37.723703 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-9ad7aea8-17e9-4da3-b1cc-e14fcdea15a6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:37.731409 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-9ad7aea8-17e9-4da3-b1cc-e14fcdea15a6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1689 microversion: 2.1 time: 0.157262 Sep 05 12:34:37.732010 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 341/691] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:37 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:38.415950 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-bfc91745-acfc-4d9f-b5cc-1e4e5093b173 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:38.416568 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-bfc91745-acfc-4d9f-b5cc-1e4e5093b173 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:38.423379 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bfc91745-acfc-4d9f-b5cc-1e4e5093b173 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:38.423897 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bfc91745-acfc-4d9f-b5cc-1e4e5093b173 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:38.424335 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bfc91745-acfc-4d9f-b5cc-1e4e5093b173 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:38.425035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bfc91745-acfc-4d9f-b5cc-1e4e5093b173 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:38.425495 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bfc91745-acfc-4d9f-b5cc-1e4e5093b173 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:38.425918 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bfc91745-acfc-4d9f-b5cc-1e4e5093b173 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:38.561598 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-bfc91745-acfc-4d9f-b5cc-1e4e5093b173 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:38.569001 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-bfc91745-acfc-4d9f-b5cc-1e4e5093b173 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1358 microversion: 2.1 time: 0.157374 Sep 05 12:34:38.569589 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 351/692] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:38 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:38.756067 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-b3108985-3b40-41e9-91f6-9536fe57006c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:38.756650 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-b3108985-3b40-41e9-91f6-9536fe57006c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:38.763639 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b3108985-3b40-41e9-91f6-9536fe57006c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:38.763813 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b3108985-3b40-41e9-91f6-9536fe57006c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:38.764252 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b3108985-3b40-41e9-91f6-9536fe57006c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:38.764992 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b3108985-3b40-41e9-91f6-9536fe57006c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:38.765450 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b3108985-3b40-41e9-91f6-9536fe57006c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:38.765875 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b3108985-3b40-41e9-91f6-9536fe57006c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:38.906671 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-b3108985-3b40-41e9-91f6-9536fe57006c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:38.914628 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-b3108985-3b40-41e9-91f6-9536fe57006c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1689 microversion: 2.1 time: 0.163166 Sep 05 12:34:38.915205 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 342/693] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:38 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:39.594034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-411116f5-9553-4d79-82f1-f8a97eeccaff tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:39.594628 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-411116f5-9553-4d79-82f1-f8a97eeccaff tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:39.601672 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-411116f5-9553-4d79-82f1-f8a97eeccaff tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:39.602150 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-411116f5-9553-4d79-82f1-f8a97eeccaff tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:39.602579 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-411116f5-9553-4d79-82f1-f8a97eeccaff tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:39.603303 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-411116f5-9553-4d79-82f1-f8a97eeccaff tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:39.603772 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-411116f5-9553-4d79-82f1-f8a97eeccaff tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:39.604193 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-411116f5-9553-4d79-82f1-f8a97eeccaff tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:39.735919 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-411116f5-9553-4d79-82f1-f8a97eeccaff tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:39.744449 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-411116f5-9553-4d79-82f1-f8a97eeccaff tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1358 microversion: 2.1 time: 0.155295 Sep 05 12:34:39.751468 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 352/694] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:39 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:39.937606 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-33a14840-b4af-454b-b171-0bdd06136b03 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:39.938350 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-33a14840-b4af-454b-b171-0bdd06136b03 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:39.944817 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-33a14840-b4af-454b-b171-0bdd06136b03 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:39.945304 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-33a14840-b4af-454b-b171-0bdd06136b03 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:39.945762 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-33a14840-b4af-454b-b171-0bdd06136b03 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:39.946467 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-33a14840-b4af-454b-b171-0bdd06136b03 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:39.946925 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-33a14840-b4af-454b-b171-0bdd06136b03 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:39.947348 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-33a14840-b4af-454b-b171-0bdd06136b03 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:40.082614 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-33a14840-b4af-454b-b171-0bdd06136b03 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:40.090617 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-33a14840-b4af-454b-b171-0bdd06136b03 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1689 microversion: 2.1 time: 0.156852 Sep 05 12:34:40.091187 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 343/695] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:39 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:40.768815 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-26d213d6-b753-46cc-bebe-659e7aef8557 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:40.769432 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-26d213d6-b753-46cc-bebe-659e7aef8557 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:40.775520 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-26d213d6-b753-46cc-bebe-659e7aef8557 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:40.776019 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-26d213d6-b753-46cc-bebe-659e7aef8557 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:40.776456 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-26d213d6-b753-46cc-bebe-659e7aef8557 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:40.777143 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-26d213d6-b753-46cc-bebe-659e7aef8557 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:40.777685 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-26d213d6-b753-46cc-bebe-659e7aef8557 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:40.778126 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-26d213d6-b753-46cc-bebe-659e7aef8557 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:40.906840 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-26d213d6-b753-46cc-bebe-659e7aef8557 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:40.914645 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-26d213d6-b753-46cc-bebe-659e7aef8557 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1358 microversion: 2.1 time: 0.150252 Sep 05 12:34:40.915241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 353/696] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:40 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:41.114940 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d19b68c8-4ceb-4d7c-ad00-f1693691ab9a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:41.115558 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d19b68c8-4ceb-4d7c-ad00-f1693691ab9a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:41.122044 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d19b68c8-4ceb-4d7c-ad00-f1693691ab9a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:41.122522 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d19b68c8-4ceb-4d7c-ad00-f1693691ab9a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:41.122947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d19b68c8-4ceb-4d7c-ad00-f1693691ab9a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:41.123666 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d19b68c8-4ceb-4d7c-ad00-f1693691ab9a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:41.124120 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d19b68c8-4ceb-4d7c-ad00-f1693691ab9a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:41.124608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d19b68c8-4ceb-4d7c-ad00-f1693691ab9a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:41.265347 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d19b68c8-4ceb-4d7c-ad00-f1693691ab9a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:41.273555 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d19b68c8-4ceb-4d7c-ad00-f1693691ab9a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1689 microversion: 2.1 time: 0.163121 Sep 05 12:34:41.274219 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 344/697] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:41 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:41.366962 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-fbbca177-c400-4710-820e-34f32fa5e0cf req-f7c7ed61-1df9-4670-8948-c570ef95dc88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8aa06a-9ac0-41d2-93ba-ae42895d418f", "name": "network-vif-plugged", "status": "completed", "tag": "484ab154-1eb7-4f51-b8a6-351d2c0646e4"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:41.376511 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-fbbca177-c400-4710-820e-34f32fa5e0cf req-f7c7ed61-1df9-4670-8948-c570ef95dc88 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:41.377815 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-fbbca177-c400-4710-820e-34f32fa5e0cf req-f7c7ed61-1df9-4670-8948-c570ef95dc88 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:41.378242 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-fbbca177-c400-4710-820e-34f32fa5e0cf req-f7c7ed61-1df9-4670-8948-c570ef95dc88 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:41.389736 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-fbbca177-c400-4710-820e-34f32fa5e0cf req-f7c7ed61-1df9-4670-8948-c570ef95dc88 service nova] Creating event network-vif-plugged:484ab154-1eb7-4f51-b8a6-351d2c0646e4 for instance 7a8aa06a-9ac0-41d2-93ba-ae42895d418f on hv-cinder-80135 Sep 05 12:34:41.398560 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-fbbca177-c400-4710-820e-34f32fa5e0cf req-f7c7ed61-1df9-4670-8948-c570ef95dc88 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035372 Sep 05 12:34:41.399194 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 354/698] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:41.481673 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-78b70a07-0c53-45e7-996c-a66cffe1f4c7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:41.482285 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-78b70a07-0c53-45e7-996c-a66cffe1f4c7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:41.489524 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-78b70a07-0c53-45e7-996c-a66cffe1f4c7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:41.489524 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-78b70a07-0c53-45e7-996c-a66cffe1f4c7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:41.489524 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-78b70a07-0c53-45e7-996c-a66cffe1f4c7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:41.489524 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-78b70a07-0c53-45e7-996c-a66cffe1f4c7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:41.497803 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-78b70a07-0c53-45e7-996c-a66cffe1f4c7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:41.497803 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-78b70a07-0c53-45e7-996c-a66cffe1f4c7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:41.520150 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-78b70a07-0c53-45e7-996c-a66cffe1f4c7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Going to try to terminate instance {{(pid=121210) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:34:41.687229 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:41.906712 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-78b70a07-0c53-45e7-996c-a66cffe1f4c7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 204 len: 0 microversion: 2.1 time: 0.428624 Sep 05 12:34:41.907733 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 345/699] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:34:41 2022] DELETE /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:34:41.917347 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a48d33f4-5e38-4d51-877e-4843f242df75 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:41.918147 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a48d33f4-5e38-4d51-877e-4843f242df75 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:41.925948 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a48d33f4-5e38-4d51-877e-4843f242df75 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:41.926437 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a48d33f4-5e38-4d51-877e-4843f242df75 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:41.927094 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a48d33f4-5e38-4d51-877e-4843f242df75 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:41.927843 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a48d33f4-5e38-4d51-877e-4843f242df75 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:41.928308 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a48d33f4-5e38-4d51-877e-4843f242df75 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:41.928733 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a48d33f4-5e38-4d51-877e-4843f242df75 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:41.940132 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-92baa64c-ed89-4e18-bc2b-893ff1185008 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:41.940993 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-92baa64c-ed89-4e18-bc2b-893ff1185008 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:41.945121 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:41.947983 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-92baa64c-ed89-4e18-bc2b-893ff1185008 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:41.948485 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-92baa64c-ed89-4e18-bc2b-893ff1185008 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:41.948960 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-92baa64c-ed89-4e18-bc2b-893ff1185008 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:41.949683 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-92baa64c-ed89-4e18-bc2b-893ff1185008 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:41.950136 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-92baa64c-ed89-4e18-bc2b-893ff1185008 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:41.950614 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-92baa64c-ed89-4e18-bc2b-893ff1185008 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:42.106343 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-92baa64c-ed89-4e18-bc2b-893ff1185008 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:42.115515 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-92baa64c-ed89-4e18-bc2b-893ff1185008 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1358 microversion: 2.1 time: 0.179417 Sep 05 12:34:42.116436 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 346/700] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:41 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:42.300362 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a8713bb4-115f-4c18-9106-46f04468c580 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:42.301276 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a8713bb4-115f-4c18-9106-46f04468c580 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:42.307868 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a8713bb4-115f-4c18-9106-46f04468c580 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:42.308360 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a8713bb4-115f-4c18-9106-46f04468c580 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:42.308788 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a8713bb4-115f-4c18-9106-46f04468c580 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:42.309711 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a8713bb4-115f-4c18-9106-46f04468c580 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:42.310175 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a8713bb4-115f-4c18-9106-46f04468c580 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:42.311701 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a8713bb4-115f-4c18-9106-46f04468c580 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:42.413311 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a48d33f4-5e38-4d51-877e-4843f242df75 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:42.422791 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a48d33f4-5e38-4d51-877e-4843f242df75 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1576 microversion: 2.1 time: 0.510150 Sep 05 12:34:42.423388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 355/701] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:41 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1576 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:42.449271 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a8713bb4-115f-4c18-9106-46f04468c580 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:42.457200 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a8713bb4-115f-4c18-9106-46f04468c580 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1689 microversion: 2.1 time: 0.161302 Sep 05 12:34:42.457781 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 347/702] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:42 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:34:43.060037 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-80308db1-ad40-493e-a925-97cc08e71ea0 req-69100e71-14c7-4aa5-94dc-016992857bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c86e0b82-f349-40c6-986b-359cb36a9862", "name": "network-vif-deleted", "tag": "66947e6f-24aa-4efc-9fc1-09b650127cb3"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:43.076811 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-80308db1-ad40-493e-a925-97cc08e71ea0 req-69100e71-14c7-4aa5-94dc-016992857bbe service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:43.077332 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-80308db1-ad40-493e-a925-97cc08e71ea0 req-69100e71-14c7-4aa5-94dc-016992857bbe service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:43.077935 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-80308db1-ad40-493e-a925-97cc08e71ea0 req-69100e71-14c7-4aa5-94dc-016992857bbe service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:43.092790 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-80308db1-ad40-493e-a925-97cc08e71ea0 req-69100e71-14c7-4aa5-94dc-016992857bbe service nova] Creating event network-vif-deleted:66947e6f-24aa-4efc-9fc1-09b650127cb3 for instance c86e0b82-f349-40c6-986b-359cb36a9862 on hv-cinder-80135 Sep 05 12:34:43.102867 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-80308db1-ad40-493e-a925-97cc08e71ea0 req-69100e71-14c7-4aa5-94dc-016992857bbe service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046623 Sep 05 12:34:43.104113 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 356/703] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:43.141485 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-c053db9b-f8bb-4b5a-a560-fb9555e0005b tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:43.142104 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-c053db9b-f8bb-4b5a-a560-fb9555e0005b tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:43.150560 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c053db9b-f8bb-4b5a-a560-fb9555e0005b tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:43.151053 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c053db9b-f8bb-4b5a-a560-fb9555e0005b tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:43.151490 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c053db9b-f8bb-4b5a-a560-fb9555e0005b tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:43.152224 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c053db9b-f8bb-4b5a-a560-fb9555e0005b tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:43.152678 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c053db9b-f8bb-4b5a-a560-fb9555e0005b tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:43.156818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c053db9b-f8bb-4b5a-a560-fb9555e0005b tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:43.310268 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c053db9b-f8bb-4b5a-a560-fb9555e0005b tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:43.319422 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-c053db9b-f8bb-4b5a-a560-fb9555e0005b tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1358 microversion: 2.1 time: 0.183647 Sep 05 12:34:43.320031 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 348/704] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:43 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:43.449380 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0e09aebe-77c6-4cb7-a797-e32c78c1a4b7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:43.450082 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0e09aebe-77c6-4cb7-a797-e32c78c1a4b7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:43.456909 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e09aebe-77c6-4cb7-a797-e32c78c1a4b7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:43.457393 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e09aebe-77c6-4cb7-a797-e32c78c1a4b7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:43.457825 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e09aebe-77c6-4cb7-a797-e32c78c1a4b7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:43.458514 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e09aebe-77c6-4cb7-a797-e32c78c1a4b7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:43.459024 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e09aebe-77c6-4cb7-a797-e32c78c1a4b7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:43.459438 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0e09aebe-77c6-4cb7-a797-e32c78c1a4b7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:43.480891 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-21b986dc-1e30-4e29-a55a-22fc24ef2e7a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:43.482067 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-21b986dc-1e30-4e29-a55a-22fc24ef2e7a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:43.489247 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-21b986dc-1e30-4e29-a55a-22fc24ef2e7a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:43.489731 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-21b986dc-1e30-4e29-a55a-22fc24ef2e7a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:43.490164 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-21b986dc-1e30-4e29-a55a-22fc24ef2e7a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:43.490863 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-21b986dc-1e30-4e29-a55a-22fc24ef2e7a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:43.491767 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-21b986dc-1e30-4e29-a55a-22fc24ef2e7a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:43.492369 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-21b986dc-1e30-4e29-a55a-22fc24ef2e7a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:43.567731 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-21b986dc-1e30-4e29-a55a-22fc24ef2e7a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:43.577419 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-21b986dc-1e30-4e29-a55a-22fc24ef2e7a tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1329 microversion: 2.1 time: 0.099639 Sep 05 12:34:43.578386 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 349/705] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:43 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1329 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:43.659741 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0e09aebe-77c6-4cb7-a797-e32c78c1a4b7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:43.675410 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0e09aebe-77c6-4cb7-a797-e32c78c1a4b7 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1576 microversion: 2.1 time: 0.230919 Sep 05 12:34:43.676139 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 357/706] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:43 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1576 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:44.344289 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-69c7d6fe-802a-45f5-abee-160a11e25f18 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:44.345013 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-69c7d6fe-802a-45f5-abee-160a11e25f18 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:44.351374 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-69c7d6fe-802a-45f5-abee-160a11e25f18 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:44.358545 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-69c7d6fe-802a-45f5-abee-160a11e25f18 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:44.358545 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-69c7d6fe-802a-45f5-abee-160a11e25f18 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:44.358545 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-69c7d6fe-802a-45f5-abee-160a11e25f18 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:44.358545 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-69c7d6fe-802a-45f5-abee-160a11e25f18 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:44.359170 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-69c7d6fe-802a-45f5-abee-160a11e25f18 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:44.498774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-69c7d6fe-802a-45f5-abee-160a11e25f18 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:44.506728 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-69c7d6fe-802a-45f5-abee-160a11e25f18 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1358 microversion: 2.1 time: 0.167914 Sep 05 12:34:44.507313 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 350/707] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:44 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:44.602312 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-b7afb9c4-10fa-4511-9137-b38a57589572 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:44.602893 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-b7afb9c4-10fa-4511-9137-b38a57589572 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:44.613895 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b7afb9c4-10fa-4511-9137-b38a57589572 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:44.614431 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b7afb9c4-10fa-4511-9137-b38a57589572 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:44.614876 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b7afb9c4-10fa-4511-9137-b38a57589572 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:44.615670 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b7afb9c4-10fa-4511-9137-b38a57589572 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:44.616155 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b7afb9c4-10fa-4511-9137-b38a57589572 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:44.616586 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b7afb9c4-10fa-4511-9137-b38a57589572 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:44.648715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b7afb9c4-10fa-4511-9137-b38a57589572 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:44.649202 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b7afb9c4-10fa-4511-9137-b38a57589572 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:44.649642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b7afb9c4-10fa-4511-9137-b38a57589572 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:44.650091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.objects.instance [None req-b7afb9c4-10fa-4511-9137-b38a57589572 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lazy-loading 'fault' on Instance uuid c86e0b82-f349-40c6-986b-359cb36a9862 {{(pid=121211) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:34:44.694607 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-b7afb9c4-10fa-4511-9137-b38a57589572 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:44.698113 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e38db1b1-91bc-4c58-baba-744fbdd2a137 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:44.698735 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-e38db1b1-91bc-4c58-baba-744fbdd2a137 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:44.702897 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-b7afb9c4-10fa-4511-9137-b38a57589572 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1334 microversion: 2.1 time: 0.104431 Sep 05 12:34:44.703488 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 358/708] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:44 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1334 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:44.704674 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e38db1b1-91bc-4c58-baba-744fbdd2a137 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:44.705185 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e38db1b1-91bc-4c58-baba-744fbdd2a137 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:44.705592 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e38db1b1-91bc-4c58-baba-744fbdd2a137 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:44.706301 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e38db1b1-91bc-4c58-baba-744fbdd2a137 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:44.706753 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e38db1b1-91bc-4c58-baba-744fbdd2a137 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:44.707171 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e38db1b1-91bc-4c58-baba-744fbdd2a137 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:44.844908 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-e38db1b1-91bc-4c58-baba-744fbdd2a137 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:44.861268 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-e38db1b1-91bc-4c58-baba-744fbdd2a137 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1576 microversion: 2.1 time: 0.159338 Sep 05 12:34:44.861268 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 351/709] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:44 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:34:45.529736 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-55b1a7f2-1132-4eb5-a814-1b7023c4cc07 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:45.530540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-55b1a7f2-1132-4eb5-a814-1b7023c4cc07 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:45.537323 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-55b1a7f2-1132-4eb5-a814-1b7023c4cc07 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:45.537814 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-55b1a7f2-1132-4eb5-a814-1b7023c4cc07 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:45.538252 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-55b1a7f2-1132-4eb5-a814-1b7023c4cc07 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:45.538943 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-55b1a7f2-1132-4eb5-a814-1b7023c4cc07 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:45.539399 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-55b1a7f2-1132-4eb5-a814-1b7023c4cc07 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:45.539866 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-55b1a7f2-1132-4eb5-a814-1b7023c4cc07 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:45.727437 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-90be3ffe-be93-450b-88e5-452d9d631872 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:45.728755 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-90be3ffe-be93-450b-88e5-452d9d631872 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:45.735576 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-90be3ffe-be93-450b-88e5-452d9d631872 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:45.736072 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-90be3ffe-be93-450b-88e5-452d9d631872 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:45.736779 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-90be3ffe-be93-450b-88e5-452d9d631872 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:45.738002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-90be3ffe-be93-450b-88e5-452d9d631872 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:45.738697 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-90be3ffe-be93-450b-88e5-452d9d631872 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:45.739044 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-90be3ffe-be93-450b-88e5-452d9d631872 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:45.776571 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-90be3ffe-be93-450b-88e5-452d9d631872 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:45.776571 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-90be3ffe-be93-450b-88e5-452d9d631872 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:45.776571 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-90be3ffe-be93-450b-88e5-452d9d631872 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:45.776571 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-90be3ffe-be93-450b-88e5-452d9d631872 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lazy-loading 'fault' on Instance uuid c86e0b82-f349-40c6-986b-359cb36a9862 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:34:45.777783 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-55b1a7f2-1132-4eb5-a814-1b7023c4cc07 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:45.788498 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-55b1a7f2-1132-4eb5-a814-1b7023c4cc07 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1358 microversion: 2.1 time: 0.262683 Sep 05 12:34:45.789419 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 359/710] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:45 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:45.822108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-90be3ffe-be93-450b-88e5-452d9d631872 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:45.831953 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-90be3ffe-be93-450b-88e5-452d9d631872 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 200 len: 1334 microversion: 2.1 time: 0.109515 Sep 05 12:34:45.838712 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 352/711] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:45 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 1334 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:34:45.876360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-202314ec-8d5f-4953-8bcd-1b0a5d045a8c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:45.877496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-202314ec-8d5f-4953-8bcd-1b0a5d045a8c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:45.883850 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-202314ec-8d5f-4953-8bcd-1b0a5d045a8c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:45.884337 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-202314ec-8d5f-4953-8bcd-1b0a5d045a8c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:45.884773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-202314ec-8d5f-4953-8bcd-1b0a5d045a8c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:45.885474 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-202314ec-8d5f-4953-8bcd-1b0a5d045a8c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:45.885923 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-202314ec-8d5f-4953-8bcd-1b0a5d045a8c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:45.886349 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-202314ec-8d5f-4953-8bcd-1b0a5d045a8c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:46.106523 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-202314ec-8d5f-4953-8bcd-1b0a5d045a8c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:46.115599 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-202314ec-8d5f-4953-8bcd-1b0a5d045a8c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1576 microversion: 2.1 time: 0.243135 Sep 05 12:34:46.116181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 360/712] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:45 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1576 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:46.432351 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-c27f3b3f-64f6-4e43-ac72-f609a5d7cd80 req-e2c1264f-02bd-453b-9dfa-7f8f618c9d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee288301-eeb1-4e09-8a2c-d9bc6c00d914", "name": "network-vif-deleted", "tag": "ebc2ee9e-37fa-4dbd-bf0a-e1f2b070c9fc"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:46.473457 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-c27f3b3f-64f6-4e43-ac72-f609a5d7cd80 req-e2c1264f-02bd-453b-9dfa-7f8f618c9d85 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:46.477491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-c27f3b3f-64f6-4e43-ac72-f609a5d7cd80 req-e2c1264f-02bd-453b-9dfa-7f8f618c9d85 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:46.478043 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-c27f3b3f-64f6-4e43-ac72-f609a5d7cd80 req-e2c1264f-02bd-453b-9dfa-7f8f618c9d85 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:46.499278 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-c27f3b3f-64f6-4e43-ac72-f609a5d7cd80 req-e2c1264f-02bd-453b-9dfa-7f8f618c9d85 service nova] Creating event network-vif-deleted:ebc2ee9e-37fa-4dbd-bf0a-e1f2b070c9fc for instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 on hv-cinder-80135 Sep 05 12:34:46.511458 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-22a5c389-7957-4a0b-aab6-91e07f40076d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bc25d85-cf25-4967-8810-d181cbb9aeee"}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:46.515068 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-22a5c389-7957-4a0b-aab6-91e07f40076d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:46.517772 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-c27f3b3f-64f6-4e43-ac72-f609a5d7cd80 req-e2c1264f-02bd-453b-9dfa-7f8f618c9d85 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175925 Sep 05 12:34:46.519789 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 353/713] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:46.525792 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-22a5c389-7957-4a0b-aab6-91e07f40076d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:46.526797 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-22a5c389-7957-4a0b-aab6-91e07f40076d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:46.527406 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-22a5c389-7957-4a0b-aab6-91e07f40076d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:46.530286 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-22a5c389-7957-4a0b-aab6-91e07f40076d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:46.530849 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-22a5c389-7957-4a0b-aab6-91e07f40076d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:46.531512 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-22a5c389-7957-4a0b-aab6-91e07f40076d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:46.640930 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-22a5c389-7957-4a0b-aab6-91e07f40076d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] HTTP exception thrown: Invalid volume: volume 4bc25d85-cf25-4967-8810-d181cbb9aeee is already attached to instances: 4d85243e-7c92-4640-8c2d-72c79cf18d76 Sep 05 12:34:46.642715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-22a5c389-7957-4a0b-aab6-91e07f40076d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Request method failure captured: Sep 05 12:34:46.642715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: POST /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76/os-volume_attachments HTTP/1.1 Sep 05 12:34:46.642715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:34:46.642715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:34:46.642715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:34:46.642715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 74 Sep 05 12:34:46.642715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:34:46.642715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:34:46.642715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:34:46.642715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:34:46.642715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFeufoItTQsL_7sLOi4KSEP2anJWuFcJFO0wxpElVaUiOIZRHfpaIO7Ki-7p9RdECrMyfb98W4yaBOl3v_K7XBLi4W-ns2FJ7XkuNLBlexiQUHW-JFKbXbPcVAg_pV0PiNN_PWY357J1AeDPeP96j3jwWObDa2p7wcvUcxOyeHOpzSuo Sep 05 12:34:46.642715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:34:46.642715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:34:46.642715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:34:46.642715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:34:46.642715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:34:46.642715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:34:46.642715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:34:46.642715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:34:46.642715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:34:46.642715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:34:46.644484 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:34:46.644484 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:34:46.644484 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:34:46.644484 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:34:46.644484 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:34:46.644484 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:34:46.644484 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:34:46.644484 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: de2273220e824339bd13d968c75df26b Sep 05 12:34:46.644484 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:34:46.644484 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Sep 05 12:34:46.644484 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {"volumeAttachment": {"volumeId": "4bc25d85-cf25-4967-8810-d181cbb9aeee"}} Sep 05 12:34:46.644484 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: > Sep 05 12:34:46.645319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Invalid volume: volume 4bc25d85-cf25-4967-8810-d181cbb9aeee is already attached to instances: 4d85243e-7c92-4640-8c2d-72c79cf18d76 Sep 05 12:34:46.645319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'server_id': '4d85243e-7c92-4640-8c2d-72c79cf18d76', 'body': {'volumeAttachment': {'volumeId': '4bc25d85-cf25-4967-8810-d181cbb9aeee'}}} Sep 05 12:34:46.645319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:34:46.645319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:46.645319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 05 12:34:46.645319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 05 12:34:46.645319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 12:34:46.645319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 12:34:46.645319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 05 12:34:46.645319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 05 12:34:46.645319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 05 12:34:46.645319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 05 12:34:46.645319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 05 12:34:46.645319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 05 12:34:46.645319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4bc25d85-cf25-4967-8810-d181cbb9aeee is already attached to instances: 4d85243e-7c92-4640-8c2d-72c79cf18d76 Sep 05 12:34:46.645319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:34:46.645319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:46.645319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:34:46.645319 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:46.646755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:46.646755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:46.646755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:34:46.646755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:34:46.646755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:34:46.646755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:34:46.646755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 12:34:46.646755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:34:46.646755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 12:34:46.646755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:34:46.646755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 12:34:46.646755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 12:34:46.646755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 05 12:34:46.646755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 05 12:34:46.646755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4bc25d85-cf25-4967-8810-d181cbb9aeee is already attached to instances: 4d85243e-7c92-4640-8c2d-72c79cf18d76 Sep 05 12:34:46.646755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:34:46.646755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:46.646755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:34:46.646755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:46.646755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:46.648301 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:46.648301 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:34:46.648301 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:34:46.648301 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4bc25d85-cf25-4967-8810-d181cbb9aeee is already attached to instances: 4d85243e-7c92-4640-8c2d-72c79cf18d76 Sep 05 12:34:46.648301 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:34:46.648301 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-22a5c389-7957-4a0b-aab6-91e07f40076d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Returning 400 to user: Invalid volume: volume 4bc25d85-cf25-4967-8810-d181cbb9aeee is already attached to instances: 4d85243e-7c92-4640-8c2d-72c79cf18d76 {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:34:46.648301 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-22a5c389-7957-4a0b-aab6-91e07f40076d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "POST /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.137815 Sep 05 12:34:46.648301 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 361/714] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Sep 5 12:34:46 2022] POST /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76/os-volume_attachments => generated 174 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 12:34:46.725164 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-3cb6eb3e-75ff-477d-b71c-d5e1d95f67be tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:46.725758 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-3cb6eb3e-75ff-477d-b71c-d5e1d95f67be tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:46.733459 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3cb6eb3e-75ff-477d-b71c-d5e1d95f67be tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:46.734203 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3cb6eb3e-75ff-477d-b71c-d5e1d95f67be tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:46.734542 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3cb6eb3e-75ff-477d-b71c-d5e1d95f67be tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:46.735301 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3cb6eb3e-75ff-477d-b71c-d5e1d95f67be tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:46.735785 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3cb6eb3e-75ff-477d-b71c-d5e1d95f67be tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:46.736275 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3cb6eb3e-75ff-477d-b71c-d5e1d95f67be tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:46.813389 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-b5857829-0379-470a-8bad-615086a8623a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:46.814779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-b5857829-0379-470a-8bad-615086a8623a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:46.823371 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b5857829-0379-470a-8bad-615086a8623a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:46.824115 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b5857829-0379-470a-8bad-615086a8623a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:46.824543 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b5857829-0379-470a-8bad-615086a8623a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:46.825466 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b5857829-0379-470a-8bad-615086a8623a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:46.826103 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b5857829-0379-470a-8bad-615086a8623a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:46.826535 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b5857829-0379-470a-8bad-615086a8623a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:46.873156 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-3cb6eb3e-75ff-477d-b71c-d5e1d95f67be tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lazy-loading 'services' on Instance uuid 4d85243e-7c92-4640-8c2d-72c79cf18d76 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:34:47.004958 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-b5857829-0379-470a-8bad-615086a8623a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:47.012973 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-b5857829-0379-470a-8bad-615086a8623a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1547 microversion: 2.1 time: 0.204502 Sep 05 12:34:47.013657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 362/715] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:46 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1547 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:34:47.018910 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3e6888e2-9e6d-49ee-9a4f-96c78874ca01 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:47.019524 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-3e6888e2-9e6d-49ee-9a4f-96c78874ca01 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: c86e0b82-f349-40c6-986b-359cb36a9862] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:47.021501 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:47.026614 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3e6888e2-9e6d-49ee-9a4f-96c78874ca01 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:47.027329 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3e6888e2-9e6d-49ee-9a4f-96c78874ca01 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:47.027955 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3e6888e2-9e6d-49ee-9a4f-96c78874ca01 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:47.028855 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3e6888e2-9e6d-49ee-9a4f-96c78874ca01 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:47.029468 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3e6888e2-9e6d-49ee-9a4f-96c78874ca01 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:47.030048 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3e6888e2-9e6d-49ee-9a4f-96c78874ca01 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:47.045910 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-3e6888e2-9e6d-49ee-9a4f-96c78874ca01 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] HTTP exception thrown: Instance c86e0b82-f349-40c6-986b-359cb36a9862 could not be found. Sep 05 12:34:47.047847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3e6888e2-9e6d-49ee-9a4f-96c78874ca01 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Request method failure captured: Sep 05 12:34:47.047847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 HTTP/1.1 Sep 05 12:34:47.047847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:34:47.047847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:34:47.047847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:34:47.047847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:34:47.047847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:34:47.047847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:34:47.047847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:34:47.047847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:34:47.047847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFeum8bx5jyveF85UtCG36zw6ZW7Ho89ZdS6sAhd29-DgS8z8mX-sxztHgo8dEEIhPTiA0DvlBnCKqmEaegTdojqUwYbH3yXd1WqKjjFpLp0dzFo0kaeLBSaKV5jpy-kf5GWYU61zSOo9eRrpikFnOvGyJFTC23WpaNWLxZkymGt-fS4 Sep 05 12:34:47.047847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:34:47.047847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:34:47.047847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:34:47.047847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:34:47.047847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:34:47.047847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:34:47.047847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 442bf64c97d945feb79f64cdd66baa28 Sep 05 12:34:47.047847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1766995040 Sep 05 12:34:47.047847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:34:47.047847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:34:47.049639 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/442bf64c97d945feb79f64cdd66baa28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/442bf64c97d945feb79f64cdd66baa28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/442bf64c97d945feb79f64cdd66baa28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_442bf64c97d945feb79f64cdd66baa28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:34:47.049639 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1766995040 Sep 05 12:34:47.049639 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 442bf64c97d945feb79f64cdd66baa28 Sep 05 12:34:47.049639 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1766995040 Sep 05 12:34:47.049639 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-ServerRescueNegativeTestJSON-1766995040-project Sep 05 12:34:47.049639 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:34:47.049639 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:34:47.049639 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: f5543fbd902d441cb6f03d3155f1af8d Sep 05 12:34:47.049639 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1766995040-project Sep 05 12:34:47.049639 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: > Sep 05 12:34:47.049639 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Instance c86e0b82-f349-40c6-986b-359cb36a9862 could not be found. Sep 05 12:34:47.049639 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': 'c86e0b82-f349-40c6-986b-359cb36a9862'} Sep 05 12:34:47.050540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:34:47.050540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:47.050540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:34:47.050540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:34:47.050540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:34:47.050540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:34:47.050540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:34:47.050540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:34:47.050540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:34:47.050540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:34:47.050540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c86e0b82-f349-40c6-986b-359cb36a9862 could not be found. Sep 05 12:34:47.050540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:34:47.050540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:47.050540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:34:47.050540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:47.050540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:47.050540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:47.050540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:34:47.050540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:34:47.050540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:34:47.052036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:34:47.052036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:34:47.052036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:34:47.052036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:34:47.052036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:34:47.052036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:34:47.052036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:34:47.052036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c86e0b82-f349-40c6-986b-359cb36a9862 could not be found. Sep 05 12:34:47.052036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:34:47.052036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:47.052036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:34:47.052036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:47.052036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:47.052036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:47.052036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:34:47.052036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:34:47.052036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c86e0b82-f349-40c6-986b-359cb36a9862 could not be found. Sep 05 12:34:47.052036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:34:47.053382 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3e6888e2-9e6d-49ee-9a4f-96c78874ca01 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Returning 404 to user: Instance c86e0b82-f349-40c6-986b-359cb36a9862 could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:34:47.053382 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3e6888e2-9e6d-49ee-9a4f-96c78874ca01 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862" status: 404 len: 111 microversion: 2.1 time: 0.034506 Sep 05 12:34:47.053653 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 363/716] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:47 2022] GET /compute/v2.1/servers/c86e0b82-f349-40c6-986b-359cb36a9862 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:34:47.058849 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c6da75b2-7dec-40de-b47e-2696a91eb2ab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:47.059478 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-c6da75b2-7dec-40de-b47e-2696a91eb2ab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:47.066300 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c6da75b2-7dec-40de-b47e-2696a91eb2ab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:47.066791 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c6da75b2-7dec-40de-b47e-2696a91eb2ab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:47.067229 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c6da75b2-7dec-40de-b47e-2696a91eb2ab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:47.067973 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c6da75b2-7dec-40de-b47e-2696a91eb2ab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:47.068431 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c6da75b2-7dec-40de-b47e-2696a91eb2ab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:47.071415 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c6da75b2-7dec-40de-b47e-2696a91eb2ab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:47.204288 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-3cb6eb3e-75ff-477d-b71c-d5e1d95f67be tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76/os-volume_attachments/4bc25d85-cf25-4967-8810-d181cbb9aeee" status: 202 len: 0 microversion: 2.1 time: 0.488656 Sep 05 12:34:47.205727 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 354/717] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Sep 5 12:34:46 2022] DELETE /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76/os-volume_attachments/4bc25d85-cf25-4967-8810-d181cbb9aeee => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:34:47.212116 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-3e526420-5739-42df-a8ff-68db719585ca tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '.version_select at 0x7fe712894160>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:47.241105 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c6da75b2-7dec-40de-b47e-2696a91eb2ab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:47.249168 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-c6da75b2-7dec-40de-b47e-2696a91eb2ab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1547 microversion: 2.1 time: 0.194574 Sep 05 12:34:47.249754 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 364/718] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:47 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1547 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:47.255432 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a60dc23d-416e-4132-a4e5-aaf426430907 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:47.256092 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a60dc23d-416e-4132-a4e5-aaf426430907 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:47.262705 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a60dc23d-416e-4132-a4e5-aaf426430907 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:47.263207 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a60dc23d-416e-4132-a4e5-aaf426430907 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:47.265621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a60dc23d-416e-4132-a4e5-aaf426430907 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:47.265621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a60dc23d-416e-4132-a4e5-aaf426430907 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:47.265621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a60dc23d-416e-4132-a4e5-aaf426430907 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:47.266140 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a60dc23d-416e-4132-a4e5-aaf426430907 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:47.303619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a60dc23d-416e-4132-a4e5-aaf426430907 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:47.304158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a60dc23d-416e-4132-a4e5-aaf426430907 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:47.304591 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a60dc23d-416e-4132-a4e5-aaf426430907 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:47.305038 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.objects.instance [None req-a60dc23d-416e-4132-a4e5-aaf426430907 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lazy-loading 'fault' on Instance uuid ee288301-eeb1-4e09-8a2c-d9bc6c00d914 {{(pid=121211) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:34:47.348981 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a60dc23d-416e-4132-a4e5-aaf426430907 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:47.357287 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a60dc23d-416e-4132-a4e5-aaf426430907 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1229 microversion: 2.1 time: 0.105774 Sep 05 12:34:47.357859 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 365/719] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:47 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1229 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:47.362920 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f129a691-8e3f-44d8-97fd-18fa7ab930fd tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:47.365192 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f129a691-8e3f-44d8-97fd-18fa7ab930fd tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:47.371365 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f129a691-8e3f-44d8-97fd-18fa7ab930fd tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:47.371900 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f129a691-8e3f-44d8-97fd-18fa7ab930fd tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:47.374709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f129a691-8e3f-44d8-97fd-18fa7ab930fd tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:47.375444 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f129a691-8e3f-44d8-97fd-18fa7ab930fd tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:47.377279 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-3e526420-5739-42df-a8ff-68db719585ca tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-852969297" status: 202 len: 0 microversion: 2.1 time: 0.169407 Sep 05 12:34:47.377826 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 355/720] 10.222.0.62 () {58 vars in 1218 bytes} [Mon Sep 5 12:34:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-852969297 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:34:47.384781 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-635b923c-764a-4395-9e7c-d8242f011a14 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:47.387258 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-635b923c-764a-4395-9e7c-d8242f011a14 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:47.388183 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f129a691-8e3f-44d8-97fd-18fa7ab930fd tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:47.388820 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f129a691-8e3f-44d8-97fd-18fa7ab930fd tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:47.394112 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-635b923c-764a-4395-9e7c-d8242f011a14 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Searching by: {'deleted': False, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f'} {{(pid=121210) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 05 12:34:47.425466 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-635b923c-764a-4395-9e7c-d8242f011a14 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:47.430704 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-635b923c-764a-4395-9e7c-d8242f011a14 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:47.430704 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-635b923c-764a-4395-9e7c-d8242f011a14 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:47.432022 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-635b923c-764a-4395-9e7c-d8242f011a14 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:47.432201 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-635b923c-764a-4395-9e7c-d8242f011a14 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:47.433611 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-635b923c-764a-4395-9e7c-d8242f011a14 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:47.448553 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f129a691-8e3f-44d8-97fd-18fa7ab930fd tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089594 Sep 05 12:34:47.449670 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 366/721] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:34:47 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:47.539166 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.multi_cell_list [None req-635b923c-764a-4395-9e7c-d8242f011a14 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 05 12:34:47.651900 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-635b923c-764a-4395-9e7c-d8242f011a14 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.272990 Sep 05 12:34:47.652480 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 356/722] 10.222.0.62 () {58 vars in 1125 bytes} [Mon Sep 5 12:34:47 2022] GET /compute/v2.1/servers => generated 342 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:47.664596 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f1050d37-b6f5-4c88-8c6d-d19b96e06aa5 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:47.665294 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f1050d37-b6f5-4c88-8c6d-d19b96e06aa5 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:47.682847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f1050d37-b6f5-4c88-8c6d-d19b96e06aa5 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:47.682847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f1050d37-b6f5-4c88-8c6d-d19b96e06aa5 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:47.682847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f1050d37-b6f5-4c88-8c6d-d19b96e06aa5 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:47.682847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f1050d37-b6f5-4c88-8c6d-d19b96e06aa5 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:47.683216 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f1050d37-b6f5-4c88-8c6d-d19b96e06aa5 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:47.683216 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f1050d37-b6f5-4c88-8c6d-d19b96e06aa5 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:47.830426 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f1050d37-b6f5-4c88-8c6d-d19b96e06aa5 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:47.838992 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f1050d37-b6f5-4c88-8c6d-d19b96e06aa5 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1547 microversion: 2.1 time: 0.178257 Sep 05 12:34:47.839715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 367/723] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:47 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1547 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:48.383022 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-f24d1eac-ff6a-4553-bdb6-a5c20bc22393 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:48.383875 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-f24d1eac-ff6a-4553-bdb6-a5c20bc22393 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:48.387294 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:48.391369 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f24d1eac-ff6a-4553-bdb6-a5c20bc22393 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:48.391369 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f24d1eac-ff6a-4553-bdb6-a5c20bc22393 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:48.391836 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f24d1eac-ff6a-4553-bdb6-a5c20bc22393 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:48.392580 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f24d1eac-ff6a-4553-bdb6-a5c20bc22393 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:48.393071 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f24d1eac-ff6a-4553-bdb6-a5c20bc22393 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:48.393499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f24d1eac-ff6a-4553-bdb6-a5c20bc22393 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:48.427463 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f24d1eac-ff6a-4553-bdb6-a5c20bc22393 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:48.427994 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f24d1eac-ff6a-4553-bdb6-a5c20bc22393 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:48.428431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f24d1eac-ff6a-4553-bdb6-a5c20bc22393 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:48.428903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-f24d1eac-ff6a-4553-bdb6-a5c20bc22393 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lazy-loading 'fault' on Instance uuid ee288301-eeb1-4e09-8a2c-d9bc6c00d914 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:34:48.462165 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f80499a1-af50-4e12-956d-1bb56ba0e6ae tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:48.464367 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f80499a1-af50-4e12-956d-1bb56ba0e6ae tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:48.471285 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f80499a1-af50-4e12-956d-1bb56ba0e6ae tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:48.471872 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f80499a1-af50-4e12-956d-1bb56ba0e6ae tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:48.472381 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f80499a1-af50-4e12-956d-1bb56ba0e6ae tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:48.472483 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f24d1eac-ff6a-4553-bdb6-a5c20bc22393 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:48.473088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f80499a1-af50-4e12-956d-1bb56ba0e6ae tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:48.473535 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f80499a1-af50-4e12-956d-1bb56ba0e6ae tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:48.473953 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f80499a1-af50-4e12-956d-1bb56ba0e6ae tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:48.480933 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-f24d1eac-ff6a-4553-bdb6-a5c20bc22393 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 200 len: 1229 microversion: 2.1 time: 0.102300 Sep 05 12:34:48.483958 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 357/724] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:48 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 1229 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:48.505631 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f80499a1-af50-4e12-956d-1bb56ba0e6ae tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047623 Sep 05 12:34:48.506440 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 368/725] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:34:48 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:34:49.506183 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-32577cbd-9421-4143-8efa-893644a041b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:49.506770 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-32577cbd-9421-4143-8efa-893644a041b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:49.514245 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-32577cbd-9421-4143-8efa-893644a041b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:49.514870 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-32577cbd-9421-4143-8efa-893644a041b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:49.515302 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-32577cbd-9421-4143-8efa-893644a041b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:49.516025 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-32577cbd-9421-4143-8efa-893644a041b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:49.516473 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-32577cbd-9421-4143-8efa-893644a041b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:49.516891 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-32577cbd-9421-4143-8efa-893644a041b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:49.517514 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3ca5c1da-b40a-44a1-b731-4381608d8984 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:49.519801 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-3ca5c1da-b40a-44a1-b731-4381608d8984 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:49.526241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3ca5c1da-b40a-44a1-b731-4381608d8984 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:49.526773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3ca5c1da-b40a-44a1-b731-4381608d8984 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:49.527171 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3ca5c1da-b40a-44a1-b731-4381608d8984 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:49.527892 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3ca5c1da-b40a-44a1-b731-4381608d8984 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:49.528338 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3ca5c1da-b40a-44a1-b731-4381608d8984 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:49.528760 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3ca5c1da-b40a-44a1-b731-4381608d8984 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:49.531726 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-32577cbd-9421-4143-8efa-893644a041b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] HTTP exception thrown: Instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 could not be found. Sep 05 12:34:49.533562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-32577cbd-9421-4143-8efa-893644a041b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Request method failure captured: Sep 05 12:34:49.533562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 HTTP/1.1 Sep 05 12:34:49.533562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:34:49.533562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:34:49.533562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:34:49.533562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:34:49.533562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:34:49.533562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:34:49.533562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:34:49.533562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:34:49.533562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFewDRUV05d29SJp_G31-6mBsZ9vrlyQ_ZP_htmzZqW05aRJ8x0UJl1DbgzMId5vwgnTf00e5lTOuYpmtU2pf1kKQbzE5swJzwlzMbyqnAWcSSpyxbgM2DqTKhtSlsJgN5i9vSnt1JYNn_BxFT2cp1rIargJd3jzhO9xyzVV4vbTYvg8 Sep 05 12:34:49.533562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:34:49.533562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:34:49.533562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:34:49.533562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:34:49.533562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:34:49.533562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:34:49.533562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 4377cb4a93524abd99acb6ebe07fd1d6 Sep 05 12:34:49.533562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-TestVolumeBootPattern-294554139 Sep 05 12:34:49.533562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:34:49.533562 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:34:49.535224 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4377cb4a93524abd99acb6ebe07fd1d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4377cb4a93524abd99acb6ebe07fd1d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4377cb4a93524abd99acb6ebe07fd1d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4377cb4a93524abd99acb6ebe07fd1d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:34:49.535224 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-TestVolumeBootPattern-294554139 Sep 05 12:34:49.535224 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 4377cb4a93524abd99acb6ebe07fd1d6 Sep 05 12:34:49.535224 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-TestVolumeBootPattern-294554139 Sep 05 12:34:49.535224 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-TestVolumeBootPattern-294554139-project Sep 05 12:34:49.535224 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:34:49.535224 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:34:49.535224 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: e7a29212dfae4a93beea7d11085cde63 Sep 05 12:34:49.535224 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-TestVolumeBootPattern-294554139-project Sep 05 12:34:49.535224 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:34:49.535224 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 could not be found. Sep 05 12:34:49.535224 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': 'ee288301-eeb1-4e09-8a2c-d9bc6c00d914'} Sep 05 12:34:49.536149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:34:49.536149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:49.536149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:34:49.536149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:34:49.536149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:34:49.536149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:34:49.536149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:34:49.536149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:34:49.536149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:34:49.536149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:34:49.536149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 could not be found. Sep 05 12:34:49.536149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:34:49.536149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:49.536149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:34:49.536149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:49.536149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:49.536149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:49.536149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:34:49.536149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:34:49.536149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:34:49.537512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:34:49.537512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:34:49.537512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:34:49.537512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:34:49.537512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:34:49.537512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:34:49.537512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:34:49.537512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 could not be found. Sep 05 12:34:49.537512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:34:49.537512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:49.537512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:34:49.537512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:49.537512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:49.537512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:49.537512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:34:49.537512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:34:49.537512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 could not be found. Sep 05 12:34:49.537512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:34:49.539442 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-32577cbd-9421-4143-8efa-893644a041b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Returning 404 to user: Instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:34:49.539442 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-32577cbd-9421-4143-8efa-893644a041b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 404 len: 111 microversion: 2.1 time: 0.033783 Sep 05 12:34:49.539442 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 358/726] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:49 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:34:49.563558 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3ca5c1da-b40a-44a1-b731-4381608d8984 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050059 Sep 05 12:34:49.564325 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 369/727] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:34:49 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 12:34:49.636569 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a6f7382f-6977-4fe0-a3ad-09f584bfdda3 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:49.637064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a6f7382f-6977-4fe0-a3ad-09f584bfdda3 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:49.643647 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a6f7382f-6977-4fe0-a3ad-09f584bfdda3 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:49.644120 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a6f7382f-6977-4fe0-a3ad-09f584bfdda3 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:49.644552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a6f7382f-6977-4fe0-a3ad-09f584bfdda3 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:49.645252 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a6f7382f-6977-4fe0-a3ad-09f584bfdda3 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:49.645734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a6f7382f-6977-4fe0-a3ad-09f584bfdda3 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:49.646144 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a6f7382f-6977-4fe0-a3ad-09f584bfdda3 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:49.657644 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-40423ca5-838b-4dfe-9c89-464d74f5f356 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1217933174", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-384624755", "security_groups": [{"name": "tempest-secgroup-smoke-1211654380"}], "block_device_mapping_v2": [{"uuid": "b0749a81-97ae-49e4-91e0-5419b04cdfc7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "38f5b205-d0f7-419a-8f07-cc61071fe0f8"}]}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:49.676731 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a6f7382f-6977-4fe0-a3ad-09f584bfdda3 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Going to try to terminate instance {{(pid=121210) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:34:49.789115 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.network.neutron [None req-40423ca5-838b-4dfe-9c89-464d74f5f356 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] validate_networks() for [('38f5b205-d0f7-419a-8f07-cc61071fe0f8', None, None, None, None, None)] {{(pid=121211) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:34:50.032513 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a6f7382f-6977-4fe0-a3ad-09f584bfdda3 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 204 len: 0 microversion: 2.1 time: 0.400299 Sep 05 12:34:50.033139 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 359/728] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:34:49 2022] DELETE /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:34:50.039020 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-8ce13cd1-8740-44c0-ba8a-094b4011ccde tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "901646c8-b466-43d0-a0aa-487a14805f63"}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:50.042307 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-8ce13cd1-8740-44c0-ba8a-094b4011ccde tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:50.047926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8ce13cd1-8740-44c0-ba8a-094b4011ccde tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:50.048394 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8ce13cd1-8740-44c0-ba8a-094b4011ccde tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:50.049429 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8ce13cd1-8740-44c0-ba8a-094b4011ccde tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:50.050092 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8ce13cd1-8740-44c0-ba8a-094b4011ccde tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:50.050532 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8ce13cd1-8740-44c0-ba8a-094b4011ccde tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:50.050946 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8ce13cd1-8740-44c0-ba8a-094b4011ccde tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:50.272520 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-40423ca5-838b-4dfe-9c89-464d74f5f356 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Flavor limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:34:50.272944 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-40423ca5-838b-4dfe-9c89-464d74f5f356 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Image limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:34:50.273447 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-40423ca5-838b-4dfe-9c89-464d74f5f356 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Flavor pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:34:50.274055 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-40423ca5-838b-4dfe-9c89-464d74f5f356 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Image pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:34:50.274601 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-40423ca5-838b-4dfe-9c89-464d74f5f356 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:34:50.283636 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-40423ca5-838b-4dfe-9c89-464d74f5f356 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:50.284153 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-40423ca5-838b-4dfe-9c89-464d74f5f356 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:50.284742 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-40423ca5-838b-4dfe-9c89-464d74f5f356 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:50.285491 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-40423ca5-838b-4dfe-9c89-464d74f5f356 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:50.285947 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-40423ca5-838b-4dfe-9c89-464d74f5f356 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:50.286374 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-40423ca5-838b-4dfe-9c89-464d74f5f356 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:50.303977 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-40423ca5-838b-4dfe-9c89-464d74f5f356 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Getting quotas for project 4377cb4a93524abd99acb6ebe07fd1d6. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:34:50.308010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-40423ca5-838b-4dfe-9c89-464d74f5f356 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Getting quotas for user e7a29212dfae4a93beea7d11085cde63 and project 4377cb4a93524abd99acb6ebe07fd1d6. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:34:50.369712 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-40423ca5-838b-4dfe-9c89-464d74f5f356 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Going to run 1 instances... {{(pid=121211) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:34:50.370348 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-40423ca5-838b-4dfe-9c89-464d74f5f356 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b0749a81-97ae-49e4-91e0-5419b04cdfc7',volume_size=None,volume_type=None)] {{(pid=121211) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:34:50.968056 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-40423ca5-838b-4dfe-9c89-464d74f5f356 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.314124 Sep 05 12:34:50.968910 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 370/729] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Sep 5 12:34:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:34:50.973793 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ce94a126-1cd5-47a6-aea2-272226dc58b2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:50.974409 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ce94a126-1cd5-47a6-aea2-272226dc58b2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:50.982330 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ce94a126-1cd5-47a6-aea2-272226dc58b2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:50.983634 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ce94a126-1cd5-47a6-aea2-272226dc58b2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:50.983634 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ce94a126-1cd5-47a6-aea2-272226dc58b2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:50.984290 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ce94a126-1cd5-47a6-aea2-272226dc58b2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:50.984752 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ce94a126-1cd5-47a6-aea2-272226dc58b2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:50.985185 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ce94a126-1cd5-47a6-aea2-272226dc58b2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:51.129791 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ce94a126-1cd5-47a6-aea2-272226dc58b2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:51.137554 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ce94a126-1cd5-47a6-aea2-272226dc58b2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 200 len: 1682 microversion: 2.1 time: 0.168064 Sep 05 12:34:51.138109 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 371/730] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:50 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:51.142520 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d9ffe19e-bb9a-4afd-a67c-07b96851d955 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:51.143790 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d9ffe19e-bb9a-4afd-a67c-07b96851d955 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:51.196599 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d9ffe19e-bb9a-4afd-a67c-07b96851d955 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:51.203470 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d9ffe19e-bb9a-4afd-a67c-07b96851d955 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1094 microversion: 2.1 time: 0.064368 Sep 05 12:34:51.204194 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 372/731] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:51 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:51.209245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4d8fdc58-dfb1-4e07-9fe0-6f2a79c50ec0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:51.209736 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4d8fdc58-dfb1-4e07-9fe0-6f2a79c50ec0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:51.215365 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4d8fdc58-dfb1-4e07-9fe0-6f2a79c50ec0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:51.215882 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4d8fdc58-dfb1-4e07-9fe0-6f2a79c50ec0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:51.216313 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4d8fdc58-dfb1-4e07-9fe0-6f2a79c50ec0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:51.216997 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4d8fdc58-dfb1-4e07-9fe0-6f2a79c50ec0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:51.217452 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4d8fdc58-dfb1-4e07-9fe0-6f2a79c50ec0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:51.217869 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4d8fdc58-dfb1-4e07-9fe0-6f2a79c50ec0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:51.249059 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4d8fdc58-dfb1-4e07-9fe0-6f2a79c50ec0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Going to try to terminate instance {{(pid=121211) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:34:51.277633 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=100 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:51.616061 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4d8fdc58-dfb1-4e07-9fe0-6f2a79c50ec0 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 204 len: 0 microversion: 2.1 time: 0.409731 Sep 05 12:34:51.617034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 373/732] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:34:51 2022] DELETE /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:34:51.625861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ff40e5fa-2ff0-45eb-a82d-b1f04f9a13c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:51.626584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ff40e5fa-2ff0-45eb-a82d-b1f04f9a13c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:51.634481 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ff40e5fa-2ff0-45eb-a82d-b1f04f9a13c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:51.635123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ff40e5fa-2ff0-45eb-a82d-b1f04f9a13c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:51.635727 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ff40e5fa-2ff0-45eb-a82d-b1f04f9a13c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:51.636437 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ff40e5fa-2ff0-45eb-a82d-b1f04f9a13c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:51.636891 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ff40e5fa-2ff0-45eb-a82d-b1f04f9a13c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:51.637313 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ff40e5fa-2ff0-45eb-a82d-b1f04f9a13c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:51.774359 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ff40e5fa-2ff0-45eb-a82d-b1f04f9a13c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:51.782438 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ff40e5fa-2ff0-45eb-a82d-b1f04f9a13c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1508 microversion: 2.1 time: 0.160876 Sep 05 12:34:51.783006 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 374/733] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:51 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:34:52.161574 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-b1b3759a-d76b-44a2-873b-7a860806868d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:52.162212 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-b1b3759a-d76b-44a2-873b-7a860806868d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:52.168150 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b1b3759a-d76b-44a2-873b-7a860806868d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:52.168636 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b1b3759a-d76b-44a2-873b-7a860806868d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:52.169086 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b1b3759a-d76b-44a2-873b-7a860806868d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:52.169773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b1b3759a-d76b-44a2-873b-7a860806868d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:52.170229 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b1b3759a-d76b-44a2-873b-7a860806868d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:52.170651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b1b3759a-d76b-44a2-873b-7a860806868d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:52.305971 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-b1b3759a-d76b-44a2-873b-7a860806868d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:52.313679 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-b1b3759a-d76b-44a2-873b-7a860806868d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 200 len: 1682 microversion: 2.1 time: 0.156086 Sep 05 12:34:52.314254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 375/734] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:52 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:34:52.319327 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1297d271-07cd-410b-9280-9b0cb3e3ba88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:52.319959 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1297d271-07cd-410b-9280-9b0cb3e3ba88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:52.325719 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1297d271-07cd-410b-9280-9b0cb3e3ba88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:52.326199 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1297d271-07cd-410b-9280-9b0cb3e3ba88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:52.326665 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1297d271-07cd-410b-9280-9b0cb3e3ba88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:52.327381 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1297d271-07cd-410b-9280-9b0cb3e3ba88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:52.327877 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1297d271-07cd-410b-9280-9b0cb3e3ba88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:52.328300 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1297d271-07cd-410b-9280-9b0cb3e3ba88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:52.389382 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1297d271-07cd-410b-9280-9b0cb3e3ba88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:52.398861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1297d271-07cd-410b-9280-9b0cb3e3ba88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1144 microversion: 2.1 time: 0.083003 Sep 05 12:34:52.399435 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 376/735] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:52 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:52.806187 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e895d7b9-407c-48ba-9b10-5aa512a3ad36 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:52.806795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e895d7b9-407c-48ba-9b10-5aa512a3ad36 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:52.813359 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e895d7b9-407c-48ba-9b10-5aa512a3ad36 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:52.813844 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e895d7b9-407c-48ba-9b10-5aa512a3ad36 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:52.814280 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e895d7b9-407c-48ba-9b10-5aa512a3ad36 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:52.814985 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e895d7b9-407c-48ba-9b10-5aa512a3ad36 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:52.815440 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e895d7b9-407c-48ba-9b10-5aa512a3ad36 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:52.815892 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e895d7b9-407c-48ba-9b10-5aa512a3ad36 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:52.947024 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e895d7b9-407c-48ba-9b10-5aa512a3ad36 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:52.955027 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e895d7b9-407c-48ba-9b10-5aa512a3ad36 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1508 microversion: 2.1 time: 0.152720 Sep 05 12:34:52.955654 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 377/736] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:52 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:34:53.337739 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1df84557-56cd-4a20-aaf3-6a2369f12a7a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:53.338423 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1df84557-56cd-4a20-aaf3-6a2369f12a7a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:53.344727 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1df84557-56cd-4a20-aaf3-6a2369f12a7a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:53.345212 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1df84557-56cd-4a20-aaf3-6a2369f12a7a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:53.346283 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1df84557-56cd-4a20-aaf3-6a2369f12a7a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:53.346992 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1df84557-56cd-4a20-aaf3-6a2369f12a7a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:53.347444 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1df84557-56cd-4a20-aaf3-6a2369f12a7a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:53.347916 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1df84557-56cd-4a20-aaf3-6a2369f12a7a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:53.483075 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1df84557-56cd-4a20-aaf3-6a2369f12a7a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:53.491123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1df84557-56cd-4a20-aaf3-6a2369f12a7a tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 200 len: 1682 microversion: 2.1 time: 0.157295 Sep 05 12:34:53.491724 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 378/737] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:53 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:34:53.496182 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-9b985735-4720-41a3-b749-f2ea210f1cc8 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:53.496787 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-9b985735-4720-41a3-b749-f2ea210f1cc8 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:53.503117 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9b985735-4720-41a3-b749-f2ea210f1cc8 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:53.503620 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9b985735-4720-41a3-b749-f2ea210f1cc8 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:53.504057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9b985735-4720-41a3-b749-f2ea210f1cc8 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:53.504751 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9b985735-4720-41a3-b749-f2ea210f1cc8 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:53.505204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9b985735-4720-41a3-b749-f2ea210f1cc8 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:53.505626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9b985735-4720-41a3-b749-f2ea210f1cc8 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:53.568796 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-9b985735-4720-41a3-b749-f2ea210f1cc8 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:53.576680 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-9b985735-4720-41a3-b749-f2ea210f1cc8 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1144 microversion: 2.1 time: 0.083926 Sep 05 12:34:53.577245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 379/738] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:53 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:53.984019 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-6d7577ab-ef06-49af-a078-c3254a4ab29c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:53.984544 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-6d7577ab-ef06-49af-a078-c3254a4ab29c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:53.991898 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6d7577ab-ef06-49af-a078-c3254a4ab29c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:53.992388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6d7577ab-ef06-49af-a078-c3254a4ab29c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:53.992887 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6d7577ab-ef06-49af-a078-c3254a4ab29c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:53.993593 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6d7577ab-ef06-49af-a078-c3254a4ab29c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:53.994050 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6d7577ab-ef06-49af-a078-c3254a4ab29c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:53.994473 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6d7577ab-ef06-49af-a078-c3254a4ab29c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:54.037839 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:54.129818 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6d7577ab-ef06-49af-a078-c3254a4ab29c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:54.138586 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-6d7577ab-ef06-49af-a078-c3254a4ab29c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1508 microversion: 2.1 time: 0.158430 Sep 05 12:34:54.139122 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 380/739] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:53 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:34:54.514478 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-fae03b6b-7e91-4e4d-ba7b-d64840ab1d88 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:54.515207 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-fae03b6b-7e91-4e4d-ba7b-d64840ab1d88 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:54.523015 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fae03b6b-7e91-4e4d-ba7b-d64840ab1d88 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:54.523499 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fae03b6b-7e91-4e4d-ba7b-d64840ab1d88 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:54.523957 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fae03b6b-7e91-4e4d-ba7b-d64840ab1d88 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:54.524703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fae03b6b-7e91-4e4d-ba7b-d64840ab1d88 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:54.525269 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fae03b6b-7e91-4e4d-ba7b-d64840ab1d88 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:54.525690 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fae03b6b-7e91-4e4d-ba7b-d64840ab1d88 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:54.644394 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-8ce13cd1-8740-44c0-ba8a-094b4011ccde tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "POST /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.609218 Sep 05 12:34:54.645234 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 360/740] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Sep 5 12:34:50 2022] POST /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f/os-volume_attachments => generated 194 bytes in 4612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:54.651806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-afae823f-029d-42fd-bc77-7fa26b4d6422 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:54.653113 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-afae823f-029d-42fd-bc77-7fa26b4d6422 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:54.661561 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-afae823f-029d-42fd-bc77-7fa26b4d6422 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:54.663215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-afae823f-029d-42fd-bc77-7fa26b4d6422 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:54.664040 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-afae823f-029d-42fd-bc77-7fa26b4d6422 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:54.665153 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-afae823f-029d-42fd-bc77-7fa26b4d6422 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:54.665845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-afae823f-029d-42fd-bc77-7fa26b4d6422 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:54.666488 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-afae823f-029d-42fd-bc77-7fa26b4d6422 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:54.739864 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-afae823f-029d-42fd-bc77-7fa26b4d6422 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:54.747773 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-afae823f-029d-42fd-bc77-7fa26b4d6422 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1136 microversion: 2.1 time: 0.100938 Sep 05 12:34:54.748348 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 361/741] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:54 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1136 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:54.868816 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-fae03b6b-7e91-4e4d-ba7b-d64840ab1d88 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:54.883663 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-fae03b6b-7e91-4e4d-ba7b-d64840ab1d88 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 200 len: 1682 microversion: 2.1 time: 0.369867 Sep 05 12:34:54.883663 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 381/742] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:54 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 1682 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:34:55.162277 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-474af3ec-6ac1-4e5b-83c9-317ffcce4363 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:55.162886 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-474af3ec-6ac1-4e5b-83c9-317ffcce4363 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:55.170963 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-474af3ec-6ac1-4e5b-83c9-317ffcce4363 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:55.171466 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-474af3ec-6ac1-4e5b-83c9-317ffcce4363 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:55.172169 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-474af3ec-6ac1-4e5b-83c9-317ffcce4363 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:55.172883 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-474af3ec-6ac1-4e5b-83c9-317ffcce4363 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:55.173341 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-474af3ec-6ac1-4e5b-83c9-317ffcce4363 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:55.174053 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-474af3ec-6ac1-4e5b-83c9-317ffcce4363 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:55.318559 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-474af3ec-6ac1-4e5b-83c9-317ffcce4363 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:55.328274 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-474af3ec-6ac1-4e5b-83c9-317ffcce4363 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1508 microversion: 2.1 time: 0.169886 Sep 05 12:34:55.331451 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 362/743] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:55 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:55.406114 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-3082af9e-503c-4acb-99b7-4c0ac9cb4bb6 req-b7cd2eda-b3ce-4819-8bfc-e9c1eb253162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2", "name": "network-vif-deleted", "tag": "2941d715-09fe-449b-bed5-764f516010b2"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:55.416736 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-3082af9e-503c-4acb-99b7-4c0ac9cb4bb6 req-b7cd2eda-b3ce-4819-8bfc-e9c1eb253162 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:55.417215 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-3082af9e-503c-4acb-99b7-4c0ac9cb4bb6 req-b7cd2eda-b3ce-4819-8bfc-e9c1eb253162 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:55.417638 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-3082af9e-503c-4acb-99b7-4c0ac9cb4bb6 req-b7cd2eda-b3ce-4819-8bfc-e9c1eb253162 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:55.430539 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-3082af9e-503c-4acb-99b7-4c0ac9cb4bb6 req-b7cd2eda-b3ce-4819-8bfc-e9c1eb253162 service nova] Creating event network-vif-deleted:2941d715-09fe-449b-bed5-764f516010b2 for instance f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 on hv-cinder-80135 Sep 05 12:34:55.436964 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-3082af9e-503c-4acb-99b7-4c0ac9cb4bb6 req-b7cd2eda-b3ce-4819-8bfc-e9c1eb253162 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034436 Sep 05 12:34:55.437340 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 382/744] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:55.771336 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-3240fdc3-5293-480b-a503-8394ce3ec915 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:55.773228 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-3240fdc3-5293-480b-a503-8394ce3ec915 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:55.782818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3240fdc3-5293-480b-a503-8394ce3ec915 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:55.784370 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3240fdc3-5293-480b-a503-8394ce3ec915 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:55.785700 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3240fdc3-5293-480b-a503-8394ce3ec915 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:55.786771 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3240fdc3-5293-480b-a503-8394ce3ec915 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:55.787635 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3240fdc3-5293-480b-a503-8394ce3ec915 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:55.788325 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3240fdc3-5293-480b-a503-8394ce3ec915 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:55.861947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-3240fdc3-5293-480b-a503-8394ce3ec915 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:55.872349 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-3240fdc3-5293-480b-a503-8394ce3ec915 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1192 microversion: 2.1 time: 0.105759 Sep 05 12:34:55.873135 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 363/745] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:55 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1192 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:55.905477 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ae1362f1-d6f2-40d7-bfbb-e0d8d5a54866 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:55.906106 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ae1362f1-d6f2-40d7-bfbb-e0d8d5a54866 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:55.913224 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ae1362f1-d6f2-40d7-bfbb-e0d8d5a54866 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:55.913719 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ae1362f1-d6f2-40d7-bfbb-e0d8d5a54866 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:55.914247 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ae1362f1-d6f2-40d7-bfbb-e0d8d5a54866 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:55.914971 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ae1362f1-d6f2-40d7-bfbb-e0d8d5a54866 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:55.915428 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ae1362f1-d6f2-40d7-bfbb-e0d8d5a54866 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:55.915887 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ae1362f1-d6f2-40d7-bfbb-e0d8d5a54866 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:56.144467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ae1362f1-d6f2-40d7-bfbb-e0d8d5a54866 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:56.153134 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ae1362f1-d6f2-40d7-bfbb-e0d8d5a54866 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 200 len: 1614 microversion: 2.1 time: 0.252363 Sep 05 12:34:56.153827 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 383/746] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:55 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 1614 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:56.359158 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4654d117-116a-425c-b3b4-86d3664664c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:56.359804 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-4654d117-116a-425c-b3b4-86d3664664c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:56.369513 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4654d117-116a-425c-b3b4-86d3664664c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:56.370506 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4654d117-116a-425c-b3b4-86d3664664c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:56.373193 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4654d117-116a-425c-b3b4-86d3664664c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:56.373193 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4654d117-116a-425c-b3b4-86d3664664c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:56.373990 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4654d117-116a-425c-b3b4-86d3664664c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:56.374776 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4654d117-116a-425c-b3b4-86d3664664c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:56.413980 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4654d117-116a-425c-b3b4-86d3664664c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:56.414464 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4654d117-116a-425c-b3b4-86d3664664c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:56.414895 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4654d117-116a-425c-b3b4-86d3664664c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:56.415552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-4654d117-116a-425c-b3b4-86d3664664c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lazy-loading 'fault' on Instance uuid f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:34:56.458451 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-4654d117-116a-425c-b3b4-86d3664664c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:56.466310 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-4654d117-116a-425c-b3b4-86d3664664c4 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 200 len: 1311 microversion: 2.1 time: 0.113264 Sep 05 12:34:56.466886 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 364/747] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:56 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 1311 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:56.895748 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-fa0ac552-bf80-4012-9ca5-29e8f8f5d348 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:56.896415 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-fa0ac552-bf80-4012-9ca5-29e8f8f5d348 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:56.907489 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fa0ac552-bf80-4012-9ca5-29e8f8f5d348 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:56.908153 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fa0ac552-bf80-4012-9ca5-29e8f8f5d348 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:56.911521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fa0ac552-bf80-4012-9ca5-29e8f8f5d348 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:56.911521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fa0ac552-bf80-4012-9ca5-29e8f8f5d348 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:56.911521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fa0ac552-bf80-4012-9ca5-29e8f8f5d348 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:56.911521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fa0ac552-bf80-4012-9ca5-29e8f8f5d348 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:56.993471 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-fa0ac552-bf80-4012-9ca5-29e8f8f5d348 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:57.008871 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-fa0ac552-bf80-4012-9ca5-29e8f8f5d348 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1210 microversion: 2.1 time: 0.116776 Sep 05 12:34:57.009717 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 384/748] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:56 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1210 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:34:57.177531 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-6d4909dc-dc95-45ca-81af-b68fd9144e65 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:57.178349 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-6d4909dc-dc95-45ca-81af-b68fd9144e65 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:57.188315 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6d4909dc-dc95-45ca-81af-b68fd9144e65 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:57.190673 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6d4909dc-dc95-45ca-81af-b68fd9144e65 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:57.193935 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6d4909dc-dc95-45ca-81af-b68fd9144e65 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:57.195025 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6d4909dc-dc95-45ca-81af-b68fd9144e65 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:57.196268 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6d4909dc-dc95-45ca-81af-b68fd9144e65 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:57.201388 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6d4909dc-dc95-45ca-81af-b68fd9144e65 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:57.239785 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6d4909dc-dc95-45ca-81af-b68fd9144e65 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:57.239785 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6d4909dc-dc95-45ca-81af-b68fd9144e65 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:57.239785 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6d4909dc-dc95-45ca-81af-b68fd9144e65 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:57.240112 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-6d4909dc-dc95-45ca-81af-b68fd9144e65 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lazy-loading 'fault' on Instance uuid 4d85243e-7c92-4640-8c2d-72c79cf18d76 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:34:57.285975 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6d4909dc-dc95-45ca-81af-b68fd9144e65 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:57.296922 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-6d4909dc-dc95-45ca-81af-b68fd9144e65 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 200 len: 1331 microversion: 2.1 time: 0.123288 Sep 05 12:34:57.297711 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 365/749] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:57 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 1331 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:57.453654 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-dbdff186-5cae-4d87-9dd9-144da5cd53db req-095fc0e0-caf5-4aca-98ed-e494ce94cb07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d85243e-7c92-4640-8c2d-72c79cf18d76", "name": "network-vif-deleted", "tag": "b6f5eb31-8603-45c5-8275-77ad7a36982d"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:57.463951 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-dbdff186-5cae-4d87-9dd9-144da5cd53db req-095fc0e0-caf5-4aca-98ed-e494ce94cb07 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:57.464435 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-dbdff186-5cae-4d87-9dd9-144da5cd53db req-095fc0e0-caf5-4aca-98ed-e494ce94cb07 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:57.464867 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-dbdff186-5cae-4d87-9dd9-144da5cd53db req-095fc0e0-caf5-4aca-98ed-e494ce94cb07 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:57.478320 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-dbdff186-5cae-4d87-9dd9-144da5cd53db req-095fc0e0-caf5-4aca-98ed-e494ce94cb07 service nova] Creating event network-vif-deleted:b6f5eb31-8603-45c5-8275-77ad7a36982d for instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 on hv-cinder-80135 Sep 05 12:34:57.489044 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-dbdff186-5cae-4d87-9dd9-144da5cd53db req-095fc0e0-caf5-4aca-98ed-e494ce94cb07 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038779 Sep 05 12:34:57.489463 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 385/750] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:57.490369 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e9187095-bdea-4655-bf4b-5c6bc92b8b83 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:57.491303 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-e9187095-bdea-4655-bf4b-5c6bc92b8b83 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:57.494683 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=2 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:57.498339 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e9187095-bdea-4655-bf4b-5c6bc92b8b83 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:57.498823 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e9187095-bdea-4655-bf4b-5c6bc92b8b83 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:57.499256 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e9187095-bdea-4655-bf4b-5c6bc92b8b83 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:57.500001 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e9187095-bdea-4655-bf4b-5c6bc92b8b83 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:57.500614 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e9187095-bdea-4655-bf4b-5c6bc92b8b83 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:57.501227 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e9187095-bdea-4655-bf4b-5c6bc92b8b83 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:57.521569 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-e9187095-bdea-4655-bf4b-5c6bc92b8b83 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] HTTP exception thrown: Instance f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 could not be found. Sep 05 12:34:57.528605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e9187095-bdea-4655-bf4b-5c6bc92b8b83 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Request method failure captured: Sep 05 12:34:57.528605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 HTTP/1.1 Sep 05 12:34:57.528605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:34:57.528605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:34:57.528605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:34:57.528605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:34:57.528605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:34:57.528605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:34:57.528605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:34:57.528605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:34:57.528605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFeum8bx5jyveF85UtCG36zw6ZW7Ho89ZdS6sAhd29-DgS8z8mX-sxztHgo8dEEIhPTiA0DvlBnCKqmEaegTdojqUwYbH3yXd1WqKjjFpLp0dzFo0kaeLBSaKV5jpy-kf5GWYU61zSOo9eRrpikFnOvGyJFTC23WpaNWLxZkymGt-fS4 Sep 05 12:34:57.528605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:34:57.528605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:34:57.528605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:34:57.528605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:34:57.528605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:34:57.528605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:34:57.528605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 442bf64c97d945feb79f64cdd66baa28 Sep 05 12:34:57.528605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1766995040 Sep 05 12:34:57.528605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:34:57.528605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:34:57.530108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/442bf64c97d945feb79f64cdd66baa28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/442bf64c97d945feb79f64cdd66baa28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/442bf64c97d945feb79f64cdd66baa28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_442bf64c97d945feb79f64cdd66baa28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:34:57.530108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1766995040 Sep 05 12:34:57.530108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 442bf64c97d945feb79f64cdd66baa28 Sep 05 12:34:57.530108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1766995040 Sep 05 12:34:57.530108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-ServerRescueNegativeTestJSON-1766995040-project Sep 05 12:34:57.530108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:34:57.530108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:34:57.530108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: f5543fbd902d441cb6f03d3155f1af8d Sep 05 12:34:57.530108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1766995040-project Sep 05 12:34:57.530108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:34:57.530108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 could not be found. Sep 05 12:34:57.530108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': 'f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2'} Sep 05 12:34:57.531435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:34:57.531435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:57.531435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:34:57.531435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:34:57.531435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:34:57.531435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:34:57.531435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:34:57.531435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:34:57.531435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:34:57.531435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:34:57.531435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 could not be found. Sep 05 12:34:57.531435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:34:57.531435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:57.531435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:34:57.531435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:57.531435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:57.531435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:57.531435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:34:57.531435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:34:57.531435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:34:57.532929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:34:57.532929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:34:57.532929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:34:57.532929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:34:57.532929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:34:57.532929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:34:57.532929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:34:57.532929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 could not be found. Sep 05 12:34:57.532929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:34:57.532929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:57.532929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:34:57.532929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:57.532929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:57.532929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:57.532929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:34:57.532929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:34:57.532929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 could not be found. Sep 05 12:34:57.532929 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:34:57.534059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e9187095-bdea-4655-bf4b-5c6bc92b8b83 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Returning 404 to user: Instance f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:34:57.534059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-e9187095-bdea-4655-bf4b-5c6bc92b8b83 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2" status: 404 len: 111 microversion: 2.1 time: 0.038960 Sep 05 12:34:57.534059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 366/751] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:57 2022] GET /compute/v2.1/servers/f49c12b7-2932-4f9e-9e35-6fc0f3ce69c2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:34:57.534446 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-db20437c-3c5c-4308-bcd9-37cefe4b5267 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:57.534778 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-db20437c-3c5c-4308-bcd9-37cefe4b5267 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:57.542008 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-db20437c-3c5c-4308-bcd9-37cefe4b5267 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:57.542504 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-db20437c-3c5c-4308-bcd9-37cefe4b5267 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:57.542967 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-db20437c-3c5c-4308-bcd9-37cefe4b5267 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:57.543708 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-db20437c-3c5c-4308-bcd9-37cefe4b5267 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:57.544346 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-db20437c-3c5c-4308-bcd9-37cefe4b5267 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:57.544780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-db20437c-3c5c-4308-bcd9-37cefe4b5267 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:57.577406 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-db20437c-3c5c-4308-bcd9-37cefe4b5267 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Going to try to terminate instance {{(pid=121211) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:34:57.699316 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-5e8fff1d-5533-4a73-8e50-5bb5c337180e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:57.699834 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-5e8fff1d-5533-4a73-8e50-5bb5c337180e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:57.705912 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5e8fff1d-5533-4a73-8e50-5bb5c337180e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:57.706405 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5e8fff1d-5533-4a73-8e50-5bb5c337180e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:57.706840 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5e8fff1d-5533-4a73-8e50-5bb5c337180e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:57.707569 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5e8fff1d-5533-4a73-8e50-5bb5c337180e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:57.708018 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5e8fff1d-5533-4a73-8e50-5bb5c337180e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:57.708447 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5e8fff1d-5533-4a73-8e50-5bb5c337180e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:57.738584 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-5e8fff1d-5533-4a73-8e50-5bb5c337180e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356/ips" status: 200 len: 152 microversion: 2.20 time: 0.172855 Sep 05 12:34:57.745728 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 367/752] 10.222.0.62 () {60 vars in 1289 bytes} [Mon Sep 5 12:34:57 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356/ips => generated 152 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 12:34:58.027877 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-db20437c-3c5c-4308-bcd9-37cefe4b5267 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "DELETE /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 204 len: 0 microversion: 2.1 time: 0.496712 Sep 05 12:34:58.027877 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 386/753] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:34:57 2022] DELETE /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:34:58.032881 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-bcc92411-4710-4e94-b7bb-4a5e6cb9c818 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:58.034323 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-bcc92411-4710-4e94-b7bb-4a5e6cb9c818 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:58.038305 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4780aef7-0c41-4802-8639-31918b6ac161 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:58.039485 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4780aef7-0c41-4802-8639-31918b6ac161 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:58.041087 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bcc92411-4710-4e94-b7bb-4a5e6cb9c818 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:58.041743 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bcc92411-4710-4e94-b7bb-4a5e6cb9c818 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:58.042357 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bcc92411-4710-4e94-b7bb-4a5e6cb9c818 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:58.043224 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bcc92411-4710-4e94-b7bb-4a5e6cb9c818 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:58.043868 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bcc92411-4710-4e94-b7bb-4a5e6cb9c818 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:58.044469 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bcc92411-4710-4e94-b7bb-4a5e6cb9c818 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:58.046825 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4780aef7-0c41-4802-8639-31918b6ac161 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:58.047575 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4780aef7-0c41-4802-8639-31918b6ac161 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:58.048082 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4780aef7-0c41-4802-8639-31918b6ac161 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:58.048501 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4780aef7-0c41-4802-8639-31918b6ac161 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:58.049623 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4780aef7-0c41-4802-8639-31918b6ac161 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:58.050175 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4780aef7-0c41-4802-8639-31918b6ac161 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:58.201563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-bcc92411-4710-4e94-b7bb-4a5e6cb9c818 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:58.210293 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-bcc92411-4710-4e94-b7bb-4a5e6cb9c818 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1278 microversion: 2.1 time: 0.180671 Sep 05 12:34:58.219495 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-4780aef7-0c41-4802-8639-31918b6ac161 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:58.225964 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 368/754] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:58 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1278 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:58.230244 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4780aef7-0c41-4802-8639-31918b6ac161 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.197323 Sep 05 12:34:58.247286 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 387/755] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:58 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:58.320915 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-3837e2b9-e546-4fda-a594-a9cef3daa8ba tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:58.321605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-3837e2b9-e546-4fda-a594-a9cef3daa8ba tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:58.327796 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3837e2b9-e546-4fda-a594-a9cef3daa8ba tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:58.328369 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3837e2b9-e546-4fda-a594-a9cef3daa8ba tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:58.328892 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3837e2b9-e546-4fda-a594-a9cef3daa8ba tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:58.329666 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3837e2b9-e546-4fda-a594-a9cef3daa8ba tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:58.330716 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3837e2b9-e546-4fda-a594-a9cef3daa8ba tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:58.331206 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3837e2b9-e546-4fda-a594-a9cef3daa8ba tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:58.345689 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-3837e2b9-e546-4fda-a594-a9cef3daa8ba tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] HTTP exception thrown: Instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 could not be found. Sep 05 12:34:58.347902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-3837e2b9-e546-4fda-a594-a9cef3daa8ba tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Request method failure captured: Sep 05 12:34:58.347902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 HTTP/1.1 Sep 05 12:34:58.347902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:34:58.347902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:34:58.347902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:34:58.347902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:34:58.347902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:34:58.347902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:34:58.347902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:34:58.347902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:34:58.347902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFeufoItTQsL_7sLOi4KSEP2anJWuFcJFO0wxpElVaUiOIZRHfpaIO7Ki-7p9RdECrMyfb98W4yaBOl3v_K7XBLi4W-ns2FJ7XkuNLBlexiQUHW-JFKbXbPcVAg_pV0PiNN_PWY357J1AeDPeP96j3jwWObDa2p7wcvUcxOyeHOpzSuo Sep 05 12:34:58.347902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:34:58.347902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:34:58.347902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:34:58.347902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:34:58.347902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:34:58.347902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:34:58.347902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:34:58.347902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:34:58.347902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:34:58.347902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:34:58.349395 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:34:58.349395 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:34:58.349395 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:34:58.349395 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:34:58.349395 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:34:58.349395 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:34:58.349395 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:34:58.349395 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: de2273220e824339bd13d968c75df26b Sep 05 12:34:58.349395 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:34:58.349395 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:34:58.349395 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 could not be found. Sep 05 12:34:58.349395 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': '4d85243e-7c92-4640-8c2d-72c79cf18d76'} Sep 05 12:34:58.350299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:34:58.350299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:58.350299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:34:58.350299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:34:58.350299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:34:58.350299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:34:58.350299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:34:58.350299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:34:58.350299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:34:58.350299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:34:58.350299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 could not be found. Sep 05 12:34:58.350299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:34:58.350299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:58.350299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:34:58.350299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:58.350299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:58.350299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:58.350299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:34:58.350299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:34:58.350299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:34:58.351757 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:34:58.351757 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:34:58.351757 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:34:58.351757 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:34:58.351757 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:34:58.351757 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:34:58.351757 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:34:58.351757 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 could not be found. Sep 05 12:34:58.351757 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:34:58.351757 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:34:58.351757 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:34:58.351757 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:34:58.351757 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:34:58.351757 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:34:58.351757 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:34:58.351757 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:34:58.351757 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 could not be found. Sep 05 12:34:58.351757 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:34:58.353832 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-3837e2b9-e546-4fda-a594-a9cef3daa8ba tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Returning 404 to user: Instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:34:58.354695 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-3837e2b9-e546-4fda-a594-a9cef3daa8ba tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 404 len: 111 microversion: 2.1 time: 0.038001 Sep 05 12:34:58.355592 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 369/756] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:58 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:34:58.364122 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-01c59eb8-e635-4cde-96eb-57af39ee22fc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '.version_select at 0x7fe7128385e0>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:58.480678 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-01c59eb8-e635-4cde-96eb-57af39ee22fc tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1864735406" status: 202 len: 0 microversion: 2.1 time: 0.120298 Sep 05 12:34:58.490318 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 388/757] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Sep 5 12:34:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1864735406 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:34:59.232375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-9c7e554c-ca12-46d3-ae11-d850b8199632 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:59.233037 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-9c7e554c-ca12-46d3-ae11-d850b8199632 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:59.240390 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9c7e554c-ca12-46d3-ae11-d850b8199632 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:59.240890 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9c7e554c-ca12-46d3-ae11-d850b8199632 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:59.241431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9c7e554c-ca12-46d3-ae11-d850b8199632 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:59.242133 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9c7e554c-ca12-46d3-ae11-d850b8199632 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:59.242585 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9c7e554c-ca12-46d3-ae11-d850b8199632 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:59.243004 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9c7e554c-ca12-46d3-ae11-d850b8199632 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:59.270452 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7c646b29-813f-437b-83e4-089064604bc1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:34:59.271127 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-7c646b29-813f-437b-83e4-089064604bc1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:34:59.278871 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7c646b29-813f-437b-83e4-089064604bc1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:59.279362 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7c646b29-813f-437b-83e4-089064604bc1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:59.279826 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7c646b29-813f-437b-83e4-089064604bc1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:59.280593 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7c646b29-813f-437b-83e4-089064604bc1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:59.281303 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7c646b29-813f-437b-83e4-089064604bc1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:59.281659 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7c646b29-813f-437b-83e4-089064604bc1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:59.401274 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-9c7e554c-ca12-46d3-ae11-d850b8199632 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:59.409877 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-9c7e554c-ca12-46d3-ae11-d850b8199632 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1278 microversion: 2.1 time: 0.181349 Sep 05 12:34:59.410474 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 370/758] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:59 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:59.414979 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7a95ce12-a748-42e4-92ea-48fe1d332ab7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Action: 'create', calling method: .version_select at 0x7fe712894af0>, body: {"keypair": {"name": "tempest-keypair-2104172297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsA/HsGJ9nzK2k+zt4YXfpOsgW510VOCFHcLlHeoBgegGIE4iz7fxgsj03KGxMbKDi0176LotGtDJfP1ZpzUlfEbuJL7nepqwJuRwmBRbkPYk9XidLFN+SFoXuHApnpoA=="}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:59.431499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-7a95ce12-a748-42e4-92ea-48fe1d332ab7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Getting quotas for project 4f6830d2e75a47c8a757d4a66c6695ca. Resources: {'key_pairs'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:34:59.434778 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-7c646b29-813f-437b-83e4-089064604bc1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:34:59.435732 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-7a95ce12-a748-42e4-92ea-48fe1d332ab7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Getting quotas for user de2273220e824339bd13d968c75df26b and project 4f6830d2e75a47c8a757d4a66c6695ca. Resources: {'key_pairs'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:34:59.443145 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-7c646b29-813f-437b-83e4-089064604bc1 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.177676 Sep 05 12:34:59.443752 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 389/759] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:34:59 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:34:59.503189 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-1433f588-67c6-4971-8351-07ca632ef579 req-12504085-061b-40ba-a16e-71962c22a6de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ca1300-109c-4625-a6f9-f7094055e384", "tag": "d439ecff-d56e-4259-b799-38d86dccd75f"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:34:59.512875 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-1433f588-67c6-4971-8351-07ca632ef579 req-12504085-061b-40ba-a16e-71962c22a6de service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:34:59.513349 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-1433f588-67c6-4971-8351-07ca632ef579 req-12504085-061b-40ba-a16e-71962c22a6de service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:34:59.513770 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-1433f588-67c6-4971-8351-07ca632ef579 req-12504085-061b-40ba-a16e-71962c22a6de service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:34:59.516663 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:59.526014 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-1433f588-67c6-4971-8351-07ca632ef579 req-12504085-061b-40ba-a16e-71962c22a6de service nova] Creating event network-changed:d439ecff-d56e-4259-b799-38d86dccd75f for instance 96ca1300-109c-4625-a6f9-f7094055e384 on hv-cinder-80135 Sep 05 12:34:59.531155 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-7a95ce12-a748-42e4-92ea-48fe1d332ab7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.119627 Sep 05 12:34:59.531332 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-1433f588-67c6-4971-8351-07ca632ef579 req-12504085-061b-40ba-a16e-71962c22a6de service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031950 Sep 05 12:34:59.531801 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 371/760] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Sep 5 12:34:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:34:59.532367 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 390/761] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:35:00.418326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e7162280-8b6d-4af1-bfb8-6afb31325f72 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:35:00.418886 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-e7162280-8b6d-4af1-bfb8-6afb31325f72 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:00.424940 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e7162280-8b6d-4af1-bfb8-6afb31325f72 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:00.425416 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e7162280-8b6d-4af1-bfb8-6afb31325f72 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:00.425839 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e7162280-8b6d-4af1-bfb8-6afb31325f72 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:00.426529 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e7162280-8b6d-4af1-bfb8-6afb31325f72 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:00.426971 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e7162280-8b6d-4af1-bfb8-6afb31325f72 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:00.427382 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e7162280-8b6d-4af1-bfb8-6afb31325f72 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:00.434179 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3bcb69ae-f664-46cb-be1b-6a6de4b04775 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:00.434891 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-3bcb69ae-f664-46cb-be1b-6a6de4b04775 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:00.437806 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=2 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:00.443967 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3bcb69ae-f664-46cb-be1b-6a6de4b04775 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:00.444463 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3bcb69ae-f664-46cb-be1b-6a6de4b04775 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:00.444915 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3bcb69ae-f664-46cb-be1b-6a6de4b04775 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:00.445623 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3bcb69ae-f664-46cb-be1b-6a6de4b04775 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:00.446078 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3bcb69ae-f664-46cb-be1b-6a6de4b04775 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:00.446498 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3bcb69ae-f664-46cb-be1b-6a6de4b04775 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:00.451824 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-e7162280-8b6d-4af1-bfb8-6afb31325f72 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lazy-loading 'flavor' on Instance uuid 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:35:00.588936 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3bcb69ae-f664-46cb-be1b-6a6de4b04775 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:00.597361 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3bcb69ae-f664-46cb-be1b-6a6de4b04775 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1278 microversion: 2.1 time: 0.167191 Sep 05 12:35:00.597948 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 391/762] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:00 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:35:00.614075 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-de4b4bc0-22a2-4233-b9fb-e7ab9662bf86 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:00.614075 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-de4b4bc0-22a2-4233-b9fb-e7ab9662bf86 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:00.614075 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-de4b4bc0-22a2-4233-b9fb-e7ab9662bf86 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:00.614075 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-de4b4bc0-22a2-4233-b9fb-e7ab9662bf86 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:00.614698 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-de4b4bc0-22a2-4233-b9fb-e7ab9662bf86 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:00.614908 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-de4b4bc0-22a2-4233-b9fb-e7ab9662bf86 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:00.615608 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-de4b4bc0-22a2-4233-b9fb-e7ab9662bf86 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:00.616234 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-de4b4bc0-22a2-4233-b9fb-e7ab9662bf86 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:00.751985 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-de4b4bc0-22a2-4233-b9fb-e7ab9662bf86 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:00.760680 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-de4b4bc0-22a2-4233-b9fb-e7ab9662bf86 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.161754 Sep 05 12:35:00.762915 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 392/763] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:00 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:01.032335 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-e7162280-8b6d-4af1-bfb8-6afb31325f72 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "POST /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356/action" status: 202 len: 0 microversion: 2.20 time: 0.617226 Sep 05 12:35:01.032335 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 372/764] 10.222.0.62 () {62 vars in 1319 bytes} [Mon Sep 5 12:35:00 2022] POST /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:35:01.040689 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-2c1d5b70-494f-4952-953f-9f379a9e833b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:01.041855 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-2c1d5b70-494f-4952-953f-9f379a9e833b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:01.048836 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2c1d5b70-494f-4952-953f-9f379a9e833b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:01.050411 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2c1d5b70-494f-4952-953f-9f379a9e833b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:01.050411 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2c1d5b70-494f-4952-953f-9f379a9e833b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:01.051095 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2c1d5b70-494f-4952-953f-9f379a9e833b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:01.051940 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2c1d5b70-494f-4952-953f-9f379a9e833b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:01.052536 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2c1d5b70-494f-4952-953f-9f379a9e833b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:01.191870 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-2c1d5b70-494f-4952-953f-9f379a9e833b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:01.201625 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-2c1d5b70-494f-4952-953f-9f379a9e833b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:01.203283 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-2c1d5b70-494f-4952-953f-9f379a9e833b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:01.204509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-2c1d5b70-494f-4952-953f-9f379a9e833b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1724 microversion: 2.20 time: 0.167759 Sep 05 12:35:01.205081 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 393/765] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:01 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:01.627743 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-aa717f32-149d-4cb3-8908-693384124b15 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:01.628518 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-aa717f32-149d-4cb3-8908-693384124b15 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:01.636420 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aa717f32-149d-4cb3-8908-693384124b15 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:01.642750 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aa717f32-149d-4cb3-8908-693384124b15 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:01.642750 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aa717f32-149d-4cb3-8908-693384124b15 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:01.642750 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aa717f32-149d-4cb3-8908-693384124b15 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:01.642750 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aa717f32-149d-4cb3-8908-693384124b15 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:01.644298 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aa717f32-149d-4cb3-8908-693384124b15 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:01.755833 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3b440185-76d0-4b1d-aad1-6f58332ea423 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1125197154", "imageRef": "7844cf5b-4975-4cb9-a7f8-31cc5e52098a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7678039b-6ecf-4526-a1ee-cbdc20c4b02b"}], "security_groups": [{"name": "tempest-securitygroup--925913956"}], "key_name": "tempest-keypair-2104172297", "user_data": "}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:35:01.764754 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=8 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:01.777129 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-aa717f32-149d-4cb3-8908-693384124b15 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:01.785313 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-aa717f32-149d-4cb3-8908-693384124b15 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1278 microversion: 2.1 time: 0.163458 Sep 05 12:35:01.791827 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 373/766] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:01 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:01.791827 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-48d971fe-8caf-4501-8c5e-43460bdd287c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:01.791827 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-48d971fe-8caf-4501-8c5e-43460bdd287c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:01.797490 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-48d971fe-8caf-4501-8c5e-43460bdd287c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:01.798045 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-48d971fe-8caf-4501-8c5e-43460bdd287c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:01.798897 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-48d971fe-8caf-4501-8c5e-43460bdd287c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:01.799872 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-48d971fe-8caf-4501-8c5e-43460bdd287c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:01.800336 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-48d971fe-8caf-4501-8c5e-43460bdd287c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:01.800754 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-48d971fe-8caf-4501-8c5e-43460bdd287c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:01.866185 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.network.neutron [None req-3b440185-76d0-4b1d-aad1-6f58332ea423 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] validate_networks() for [('7678039b-6ecf-4526-a1ee-cbdc20c4b02b', None, None, None, None, None)] {{(pid=121211) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:35:01.934180 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-48d971fe-8caf-4501-8c5e-43460bdd287c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:01.942366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-48d971fe-8caf-4501-8c5e-43460bdd287c tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1523 microversion: 2.1 time: 0.155473 Sep 05 12:35:01.942940 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 374/767] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:01 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:02.231707 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7ff7881e-8890-4bb7-a679-d20a51fbefb8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:02.232664 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-7ff7881e-8890-4bb7-a679-d20a51fbefb8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:02.241248 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7ff7881e-8890-4bb7-a679-d20a51fbefb8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:02.241737 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7ff7881e-8890-4bb7-a679-d20a51fbefb8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:02.242166 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7ff7881e-8890-4bb7-a679-d20a51fbefb8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:02.242952 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7ff7881e-8890-4bb7-a679-d20a51fbefb8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:02.243407 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7ff7881e-8890-4bb7-a679-d20a51fbefb8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:02.243847 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7ff7881e-8890-4bb7-a679-d20a51fbefb8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:02.388109 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-7ff7881e-8890-4bb7-a679-d20a51fbefb8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:02.396902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-7ff7881e-8890-4bb7-a679-d20a51fbefb8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:02.398356 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-7ff7881e-8890-4bb7-a679-d20a51fbefb8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:02.399504 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-7ff7881e-8890-4bb7-a679-d20a51fbefb8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1724 microversion: 2.20 time: 0.173189 Sep 05 12:35:02.400313 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 375/768] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:02 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:35:02.498472 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-3b440185-76d0-4b1d-aad1-6f58332ea423 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Flavor limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:35:02.498894 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-3b440185-76d0-4b1d-aad1-6f58332ea423 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Image limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:35:02.499368 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-3b440185-76d0-4b1d-aad1-6f58332ea423 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Flavor pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:35:02.499808 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-3b440185-76d0-4b1d-aad1-6f58332ea423 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Image pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:35:02.500219 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-3b440185-76d0-4b1d-aad1-6f58332ea423 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:35:02.502734 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:02.511164 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3b440185-76d0-4b1d-aad1-6f58332ea423 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:02.511676 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3b440185-76d0-4b1d-aad1-6f58332ea423 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:02.512106 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3b440185-76d0-4b1d-aad1-6f58332ea423 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:02.512896 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3b440185-76d0-4b1d-aad1-6f58332ea423 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:02.513454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3b440185-76d0-4b1d-aad1-6f58332ea423 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:02.513884 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3b440185-76d0-4b1d-aad1-6f58332ea423 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:02.534001 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-3b440185-76d0-4b1d-aad1-6f58332ea423 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Getting quotas for project 4f6830d2e75a47c8a757d4a66c6695ca. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:35:02.538274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-3b440185-76d0-4b1d-aad1-6f58332ea423 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Getting quotas for user de2273220e824339bd13d968c75df26b and project 4f6830d2e75a47c8a757d4a66c6695ca. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:35:02.549825 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-3b440185-76d0-4b1d-aad1-6f58332ea423 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Going to run 1 instances... {{(pid=121211) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:35:02.554891 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-3b440185-76d0-4b1d-aad1-6f58332ea423 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7844cf5b-4975-4cb9-a7f8-31cc5e52098a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121211) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:35:02.698280 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3b440185-76d0-4b1d-aad1-6f58332ea423 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.947498 Sep 05 12:35:02.698930 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 394/769] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Sep 5 12:35:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 05 12:35:02.709953 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-547f6dea-b679-48da-9912-20c7968ccc5c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:02.710609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-547f6dea-b679-48da-9912-20c7968ccc5c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:02.790115 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-547f6dea-b679-48da-9912-20c7968ccc5c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:02.799266 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-547f6dea-b679-48da-9912-20c7968ccc5c tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5" status: 200 len: 1242 microversion: 2.1 time: 0.092898 Sep 05 12:35:02.799899 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 376/770] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:02 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:35:02.814518 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8c681535-b730-4e75-8ba4-9443c0b4a9b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:02.820636 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-8c681535-b730-4e75-8ba4-9443c0b4a9b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:02.825964 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8c681535-b730-4e75-8ba4-9443c0b4a9b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:02.826546 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8c681535-b730-4e75-8ba4-9443c0b4a9b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:02.827095 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8c681535-b730-4e75-8ba4-9443c0b4a9b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:02.827945 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8c681535-b730-4e75-8ba4-9443c0b4a9b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:02.828494 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8c681535-b730-4e75-8ba4-9443c0b4a9b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:02.829008 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8c681535-b730-4e75-8ba4-9443c0b4a9b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:02.966143 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-cfff87d8-f1ec-4786-9132-afcb70148c4d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:02.966936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-cfff87d8-f1ec-4786-9132-afcb70148c4d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:02.975313 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cfff87d8-f1ec-4786-9132-afcb70148c4d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:02.976001 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cfff87d8-f1ec-4786-9132-afcb70148c4d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:02.976460 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cfff87d8-f1ec-4786-9132-afcb70148c4d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:02.977197 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cfff87d8-f1ec-4786-9132-afcb70148c4d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:02.977671 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cfff87d8-f1ec-4786-9132-afcb70148c4d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:02.980889 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cfff87d8-f1ec-4786-9132-afcb70148c4d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:03.049635 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-cfff87d8-f1ec-4786-9132-afcb70148c4d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:03.055432 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:03.062366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-cfff87d8-f1ec-4786-9132-afcb70148c4d tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1481 microversion: 2.1 time: 0.099085 Sep 05 12:35:03.063047 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 377/771] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:02 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1481 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:35:03.093966 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-3849701e-4551-4f05-9b4b-ded3cf4fc666 req-4bb3bce7-9ffd-4dd0-a334-c349afb36d08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83fdb4c3-ab13-406e-8f5c-a8a7e481374f", "name": "network-vif-deleted", "tag": "5d2944c4-c65b-49e5-b532-6867e3db6d0c"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:35:03.105119 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-3849701e-4551-4f05-9b4b-ded3cf4fc666 req-4bb3bce7-9ffd-4dd0-a334-c349afb36d08 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:03.105655 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-3849701e-4551-4f05-9b4b-ded3cf4fc666 req-4bb3bce7-9ffd-4dd0-a334-c349afb36d08 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:03.106378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-3849701e-4551-4f05-9b4b-ded3cf4fc666 req-4bb3bce7-9ffd-4dd0-a334-c349afb36d08 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:03.119270 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-3849701e-4551-4f05-9b4b-ded3cf4fc666 req-4bb3bce7-9ffd-4dd0-a334-c349afb36d08 service nova] Creating event network-vif-deleted:5d2944c4-c65b-49e5-b532-6867e3db6d0c for instance 83fdb4c3-ab13-406e-8f5c-a8a7e481374f on hv-cinder-80135 Sep 05 12:35:03.125521 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-3849701e-4551-4f05-9b4b-ded3cf4fc666 req-4bb3bce7-9ffd-4dd0-a334-c349afb36d08 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035369 Sep 05 12:35:03.126204 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 378/772] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:35:03.155736 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-8c681535-b730-4e75-8ba4-9443c0b4a9b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:03.164622 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-8c681535-b730-4e75-8ba4-9443c0b4a9b1 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1278 microversion: 2.1 time: 0.354956 Sep 05 12:35:03.165190 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 395/773] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:02 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1278 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:03.425768 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-8009aa0a-35db-4653-8898-cfd6dff6d475 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:03.426495 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-8009aa0a-35db-4653-8898-cfd6dff6d475 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:03.438928 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8009aa0a-35db-4653-8898-cfd6dff6d475 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:03.439410 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8009aa0a-35db-4653-8898-cfd6dff6d475 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:03.440393 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8009aa0a-35db-4653-8898-cfd6dff6d475 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:03.444393 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8009aa0a-35db-4653-8898-cfd6dff6d475 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:03.444886 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8009aa0a-35db-4653-8898-cfd6dff6d475 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:03.445446 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8009aa0a-35db-4653-8898-cfd6dff6d475 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:03.447048 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-441b2d41-7853-4e6b-8be5-5007696214e7 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:03.447694 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-441b2d41-7853-4e6b-8be5-5007696214e7 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:03.459789 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-441b2d41-7853-4e6b-8be5-5007696214e7 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:03.460353 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-441b2d41-7853-4e6b-8be5-5007696214e7 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:03.461994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-441b2d41-7853-4e6b-8be5-5007696214e7 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:03.462811 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-441b2d41-7853-4e6b-8be5-5007696214e7 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:03.465263 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-441b2d41-7853-4e6b-8be5-5007696214e7 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:03.465847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-441b2d41-7853-4e6b-8be5-5007696214e7 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:03.655587 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-441b2d41-7853-4e6b-8be5-5007696214e7 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:03.665538 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-441b2d41-7853-4e6b-8be5-5007696214e7 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1593 microversion: 2.1 time: 0.222237 Sep 05 12:35:03.666132 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 396/774] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:03 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1593 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:03.822525 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e68f5c31-39a3-4046-8182-18e99a85b7d6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:03.826284 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e68f5c31-39a3-4046-8182-18e99a85b7d6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:03.829772 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e68f5c31-39a3-4046-8182-18e99a85b7d6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:03.830829 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e68f5c31-39a3-4046-8182-18e99a85b7d6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:03.831266 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e68f5c31-39a3-4046-8182-18e99a85b7d6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:03.832088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e68f5c31-39a3-4046-8182-18e99a85b7d6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:03.832541 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e68f5c31-39a3-4046-8182-18e99a85b7d6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:03.832960 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e68f5c31-39a3-4046-8182-18e99a85b7d6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:03.889552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-8009aa0a-35db-4653-8898-cfd6dff6d475 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:03.901262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-8009aa0a-35db-4653-8898-cfd6dff6d475 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:03.901262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-8009aa0a-35db-4653-8898-cfd6dff6d475 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:03.902065 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-8009aa0a-35db-4653-8898-cfd6dff6d475 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1724 microversion: 2.20 time: 0.480605 Sep 05 12:35:03.904088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e68f5c31-39a3-4046-8182-18e99a85b7d6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:03.916063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 379/775] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:03 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1724 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:03.923021 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e68f5c31-39a3-4046-8182-18e99a85b7d6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5" status: 200 len: 1246 microversion: 2.1 time: 0.104589 Sep 05 12:35:03.923711 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 397/776] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:03 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 => generated 1246 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:35:04.093737 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d4004021-3e5a-49d6-8dbb-ffb15cc75ee6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:04.094732 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d4004021-3e5a-49d6-8dbb-ffb15cc75ee6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:04.102942 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d4004021-3e5a-49d6-8dbb-ffb15cc75ee6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:04.104020 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d4004021-3e5a-49d6-8dbb-ffb15cc75ee6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:04.104691 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d4004021-3e5a-49d6-8dbb-ffb15cc75ee6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:04.105912 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d4004021-3e5a-49d6-8dbb-ffb15cc75ee6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:04.106384 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d4004021-3e5a-49d6-8dbb-ffb15cc75ee6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:04.106820 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d4004021-3e5a-49d6-8dbb-ffb15cc75ee6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:04.148304 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d4004021-3e5a-49d6-8dbb-ffb15cc75ee6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:04.149076 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d4004021-3e5a-49d6-8dbb-ffb15cc75ee6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:04.149516 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d4004021-3e5a-49d6-8dbb-ffb15cc75ee6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:04.149970 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-d4004021-3e5a-49d6-8dbb-ffb15cc75ee6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lazy-loading 'fault' on Instance uuid 83fdb4c3-ab13-406e-8f5c-a8a7e481374f {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:35:04.187905 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ae5903fe-ec98-47c6-8ede-431d3108d0d2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:04.188521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ae5903fe-ec98-47c6-8ede-431d3108d0d2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:04.194636 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d4004021-3e5a-49d6-8dbb-ffb15cc75ee6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5543fbd902d441cb6f03d3155f1af8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bf64c97d945feb79f64cdd66baa28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:04.195385 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ae5903fe-ec98-47c6-8ede-431d3108d0d2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:04.200174 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ae5903fe-ec98-47c6-8ede-431d3108d0d2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:04.200712 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ae5903fe-ec98-47c6-8ede-431d3108d0d2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:04.201546 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ae5903fe-ec98-47c6-8ede-431d3108d0d2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:04.202348 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ae5903fe-ec98-47c6-8ede-431d3108d0d2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:04.202797 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ae5903fe-ec98-47c6-8ede-431d3108d0d2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:04.203774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d4004021-3e5a-49d6-8dbb-ffb15cc75ee6 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 200 len: 1312 microversion: 2.1 time: 0.114357 Sep 05 12:35:04.216734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 380/777] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:04 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 1312 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:04.404607 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ae5903fe-ec98-47c6-8ede-431d3108d0d2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:04.414071 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ae5903fe-ec98-47c6-8ede-431d3108d0d2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1278 microversion: 2.1 time: 0.230094 Sep 05 12:35:04.414665 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 398/778] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:04 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1278 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:35:04.929341 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-de70ab13-5a32-4691-a7c1-7db40dd68115 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:04.929886 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-de70ab13-5a32-4691-a7c1-7db40dd68115 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:04.937672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-de70ab13-5a32-4691-a7c1-7db40dd68115 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:04.938760 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-de70ab13-5a32-4691-a7c1-7db40dd68115 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:04.939360 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-de70ab13-5a32-4691-a7c1-7db40dd68115 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:04.943984 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-de70ab13-5a32-4691-a7c1-7db40dd68115 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:04.944715 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-de70ab13-5a32-4691-a7c1-7db40dd68115 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:04.945150 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-de70ab13-5a32-4691-a7c1-7db40dd68115 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:04.948826 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-78fde6fa-79bc-4e3a-8fba-fc8f5c623176 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:04.951236 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-78fde6fa-79bc-4e3a-8fba-fc8f5c623176 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:04.964992 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-78fde6fa-79bc-4e3a-8fba-fc8f5c623176 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:04.966250 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-78fde6fa-79bc-4e3a-8fba-fc8f5c623176 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:04.966842 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-78fde6fa-79bc-4e3a-8fba-fc8f5c623176 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:04.967874 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-78fde6fa-79bc-4e3a-8fba-fc8f5c623176 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:04.968369 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-78fde6fa-79bc-4e3a-8fba-fc8f5c623176 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:04.968997 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-78fde6fa-79bc-4e3a-8fba-fc8f5c623176 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:05.068003 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-78fde6fa-79bc-4e3a-8fba-fc8f5c623176 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:05.078713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-78fde6fa-79bc-4e3a-8fba-fc8f5c623176 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5" status: 200 len: 1294 microversion: 2.1 time: 0.134356 Sep 05 12:35:05.079425 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 399/779] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:04 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 => generated 1294 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:05.114137 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-de70ab13-5a32-4691-a7c1-7db40dd68115 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:05.123041 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-de70ab13-5a32-4691-a7c1-7db40dd68115 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:05.124552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-de70ab13-5a32-4691-a7c1-7db40dd68115 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:05.125755 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-de70ab13-5a32-4691-a7c1-7db40dd68115 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1724 microversion: 2.20 time: 0.200796 Sep 05 12:35:05.126538 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 381/780] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:04 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:05.229612 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-43876566-c645-49df-8114-16b5116ef994 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:05.230232 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-43876566-c645-49df-8114-16b5116ef994 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] [instance: 83fdb4c3-ab13-406e-8f5c-a8a7e481374f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:05.237598 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-43876566-c645-49df-8114-16b5116ef994 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:05.238351 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-43876566-c645-49df-8114-16b5116ef994 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:05.238782 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-43876566-c645-49df-8114-16b5116ef994 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:05.239482 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-43876566-c645-49df-8114-16b5116ef994 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:05.239976 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-43876566-c645-49df-8114-16b5116ef994 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:05.240401 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-43876566-c645-49df-8114-16b5116ef994 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:05.255109 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-43876566-c645-49df-8114-16b5116ef994 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] HTTP exception thrown: Instance 83fdb4c3-ab13-406e-8f5c-a8a7e481374f could not be found. Sep 05 12:35:05.256822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-43876566-c645-49df-8114-16b5116ef994 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Request method failure captured: Sep 05 12:35:05.256822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f HTTP/1.1 Sep 05 12:35:05.256822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:35:05.256822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:35:05.256822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:35:05.256822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:35:05.256822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:35:05.256822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:35:05.256822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:35:05.256822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:35:05.256822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFeum8bx5jyveF85UtCG36zw6ZW7Ho89ZdS6sAhd29-DgS8z8mX-sxztHgo8dEEIhPTiA0DvlBnCKqmEaegTdojqUwYbH3yXd1WqKjjFpLp0dzFo0kaeLBSaKV5jpy-kf5GWYU61zSOo9eRrpikFnOvGyJFTC23WpaNWLxZkymGt-fS4 Sep 05 12:35:05.256822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:35:05.256822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:35:05.256822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:35:05.256822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:35:05.256822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:35:05.256822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:35:05.256822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 442bf64c97d945feb79f64cdd66baa28 Sep 05 12:35:05.256822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1766995040 Sep 05 12:35:05.256822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:35:05.256822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:35:05.258629 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/442bf64c97d945feb79f64cdd66baa28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/442bf64c97d945feb79f64cdd66baa28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/442bf64c97d945feb79f64cdd66baa28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_442bf64c97d945feb79f64cdd66baa28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:35:05.258629 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1766995040 Sep 05 12:35:05.258629 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 442bf64c97d945feb79f64cdd66baa28 Sep 05 12:35:05.258629 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1766995040 Sep 05 12:35:05.258629 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-ServerRescueNegativeTestJSON-1766995040-project Sep 05 12:35:05.258629 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:35:05.258629 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:35:05.258629 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: f5543fbd902d441cb6f03d3155f1af8d Sep 05 12:35:05.258629 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1766995040-project Sep 05 12:35:05.258629 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: > Sep 05 12:35:05.258629 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Instance 83fdb4c3-ab13-406e-8f5c-a8a7e481374f could not be found. Sep 05 12:35:05.258629 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': '83fdb4c3-ab13-406e-8f5c-a8a7e481374f'} Sep 05 12:35:05.263034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:35:05.263034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:35:05.263034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:35:05.263034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:35:05.263034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:35:05.263034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:35:05.263034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:35:05.263034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:35:05.263034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:35:05.263034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:35:05.263034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83fdb4c3-ab13-406e-8f5c-a8a7e481374f could not be found. Sep 05 12:35:05.263034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:35:05.263034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:35:05.263034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:35:05.263034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:35:05.263034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:35:05.263034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:35:05.263034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:35:05.263034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:35:05.263034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:35:05.264683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:35:05.264683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:35:05.264683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:35:05.264683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:35:05.264683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:35:05.264683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:35:05.264683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:35:05.264683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83fdb4c3-ab13-406e-8f5c-a8a7e481374f could not be found. Sep 05 12:35:05.264683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:35:05.264683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:35:05.264683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:35:05.264683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:35:05.264683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:35:05.264683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:35:05.264683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:35:05.264683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:35:05.264683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83fdb4c3-ab13-406e-8f5c-a8a7e481374f could not be found. Sep 05 12:35:05.264683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:35:05.265876 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-43876566-c645-49df-8114-16b5116ef994 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] Returning 404 to user: Instance 83fdb4c3-ab13-406e-8f5c-a8a7e481374f could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:35:05.265876 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-43876566-c645-49df-8114-16b5116ef994 tempest-ServerRescueNegativeTestJSON-1766995040 tempest-ServerRescueNegativeTestJSON-1766995040-project] 10.222.0.62 "GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f" status: 404 len: 111 microversion: 2.1 time: 0.032716 Sep 05 12:35:05.265876 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 400/781] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:05 2022] GET /compute/v2.1/servers/83fdb4c3-ab13-406e-8f5c-a8a7e481374f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:35:05.437074 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-218e0a42-6631-4e01-9c6b-10ae277441e2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:05.437694 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-218e0a42-6631-4e01-9c6b-10ae277441e2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:05.446386 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-218e0a42-6631-4e01-9c6b-10ae277441e2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:05.452162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-218e0a42-6631-4e01-9c6b-10ae277441e2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:05.452162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-218e0a42-6631-4e01-9c6b-10ae277441e2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:05.452162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-218e0a42-6631-4e01-9c6b-10ae277441e2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:05.452162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-218e0a42-6631-4e01-9c6b-10ae277441e2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:05.452565 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-218e0a42-6631-4e01-9c6b-10ae277441e2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:05.679172 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-218e0a42-6631-4e01-9c6b-10ae277441e2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:05.688606 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-218e0a42-6631-4e01-9c6b-10ae277441e2 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1266 microversion: 2.1 time: 0.255301 Sep 05 12:35:05.689255 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 382/782] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:05 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:06.110300 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ca2b6613-0329-4940-b628-9c7f672db5af tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:06.110837 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ca2b6613-0329-4940-b628-9c7f672db5af tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:06.120395 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ca2b6613-0329-4940-b628-9c7f672db5af tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:06.120395 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ca2b6613-0329-4940-b628-9c7f672db5af tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:06.120395 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ca2b6613-0329-4940-b628-9c7f672db5af tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:06.120395 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ca2b6613-0329-4940-b628-9c7f672db5af tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:06.120845 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ca2b6613-0329-4940-b628-9c7f672db5af tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:06.120845 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ca2b6613-0329-4940-b628-9c7f672db5af tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:06.155181 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-fea8b4ff-0c68-4953-b6d6-6ea792bb8c62 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:06.155927 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-fea8b4ff-0c68-4953-b6d6-6ea792bb8c62 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:06.172378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fea8b4ff-0c68-4953-b6d6-6ea792bb8c62 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:06.176442 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fea8b4ff-0c68-4953-b6d6-6ea792bb8c62 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:06.176893 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fea8b4ff-0c68-4953-b6d6-6ea792bb8c62 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:06.181066 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fea8b4ff-0c68-4953-b6d6-6ea792bb8c62 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:06.181773 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fea8b4ff-0c68-4953-b6d6-6ea792bb8c62 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:06.182213 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fea8b4ff-0c68-4953-b6d6-6ea792bb8c62 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:06.270329 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ca2b6613-0329-4940-b628-9c7f672db5af tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:06.278728 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ca2b6613-0329-4940-b628-9c7f672db5af tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5" status: 200 len: 1302 microversion: 2.1 time: 0.172273 Sep 05 12:35:06.279808 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 401/783] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:06 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 => generated 1302 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:06.453040 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-fea8b4ff-0c68-4953-b6d6-6ea792bb8c62 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:06.468076 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-fea8b4ff-0c68-4953-b6d6-6ea792bb8c62 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:06.470151 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-fea8b4ff-0c68-4953-b6d6-6ea792bb8c62 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:06.471504 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-fea8b4ff-0c68-4953-b6d6-6ea792bb8c62 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1724 microversion: 2.20 time: 0.320394 Sep 05 12:35:06.472821 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 383/784] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:06 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1724 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:06.530132 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-ef3ab3e9-f3a1-4da7-86f2-c646deb6d151 req-05477dda-dfff-430c-923d-f164cf85d17a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8aa06a-9ac0-41d2-93ba-ae42895d418f", "tag": "484ab154-1eb7-4f51-b8a6-351d2c0646e4"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:35:06.542610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-ef3ab3e9-f3a1-4da7-86f2-c646deb6d151 req-05477dda-dfff-430c-923d-f164cf85d17a service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:06.543116 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-ef3ab3e9-f3a1-4da7-86f2-c646deb6d151 req-05477dda-dfff-430c-923d-f164cf85d17a service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:06.543529 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-ef3ab3e9-f3a1-4da7-86f2-c646deb6d151 req-05477dda-dfff-430c-923d-f164cf85d17a service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:06.557645 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-ef3ab3e9-f3a1-4da7-86f2-c646deb6d151 req-05477dda-dfff-430c-923d-f164cf85d17a service nova] Creating event network-changed:484ab154-1eb7-4f51-b8a6-351d2c0646e4 for instance 7a8aa06a-9ac0-41d2-93ba-ae42895d418f on hv-cinder-80135 Sep 05 12:35:06.561610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-ef3ab3e9-f3a1-4da7-86f2-c646deb6d151 req-05477dda-dfff-430c-923d-f164cf85d17a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036192 Sep 05 12:35:06.562300 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 402/785] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:35:06.712895 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-3d3dc7f6-36a4-4b2f-9241-24938c81ca3b tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:06.716453 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-3d3dc7f6-36a4-4b2f-9241-24938c81ca3b tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:06.729483 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3d3dc7f6-36a4-4b2f-9241-24938c81ca3b tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:06.731355 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3d3dc7f6-36a4-4b2f-9241-24938c81ca3b tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:06.733458 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3d3dc7f6-36a4-4b2f-9241-24938c81ca3b tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:06.739500 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3d3dc7f6-36a4-4b2f-9241-24938c81ca3b tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:06.739500 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3d3dc7f6-36a4-4b2f-9241-24938c81ca3b tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:06.741250 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3d3dc7f6-36a4-4b2f-9241-24938c81ca3b tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:07.093895 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-3d3dc7f6-36a4-4b2f-9241-24938c81ca3b tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:07.103927 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-3d3dc7f6-36a4-4b2f-9241-24938c81ca3b tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1266 microversion: 2.1 time: 0.394842 Sep 05 12:35:07.106706 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 384/786] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:06 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1266 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:07.304343 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-31f6876e-64d1-4c15-b837-66283fc2fa8b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:07.305879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-31f6876e-64d1-4c15-b837-66283fc2fa8b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:07.321037 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-31f6876e-64d1-4c15-b837-66283fc2fa8b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:07.321648 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-31f6876e-64d1-4c15-b837-66283fc2fa8b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:07.322093 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-31f6876e-64d1-4c15-b837-66283fc2fa8b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:07.322821 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-31f6876e-64d1-4c15-b837-66283fc2fa8b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:07.323471 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-31f6876e-64d1-4c15-b837-66283fc2fa8b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:07.324090 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-31f6876e-64d1-4c15-b837-66283fc2fa8b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:07.500370 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-20676d04-354b-4f5f-917c-32164a6f074e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:07.505694 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-20676d04-354b-4f5f-917c-32164a6f074e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:07.534799 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-20676d04-354b-4f5f-917c-32164a6f074e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:07.534799 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-20676d04-354b-4f5f-917c-32164a6f074e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:07.540186 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-20676d04-354b-4f5f-917c-32164a6f074e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:07.541268 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-20676d04-354b-4f5f-917c-32164a6f074e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:07.541915 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-20676d04-354b-4f5f-917c-32164a6f074e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:07.542533 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-20676d04-354b-4f5f-917c-32164a6f074e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:07.647764 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-31f6876e-64d1-4c15-b837-66283fc2fa8b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:07.662682 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-31f6876e-64d1-4c15-b837-66283fc2fa8b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5" status: 200 len: 1367 microversion: 2.1 time: 0.359419 Sep 05 12:35:07.664943 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 403/787] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:07 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 => generated 1367 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:08.133977 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-b75c549d-e622-4d88-bf9e-faf5d16e085e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:08.136546 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-b75c549d-e622-4d88-bf9e-faf5d16e085e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:08.148209 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b75c549d-e622-4d88-bf9e-faf5d16e085e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:08.149602 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b75c549d-e622-4d88-bf9e-faf5d16e085e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:08.150713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b75c549d-e622-4d88-bf9e-faf5d16e085e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:08.152380 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b75c549d-e622-4d88-bf9e-faf5d16e085e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:08.153555 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b75c549d-e622-4d88-bf9e-faf5d16e085e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:08.154707 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b75c549d-e622-4d88-bf9e-faf5d16e085e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:08.206626 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-20676d04-354b-4f5f-917c-32164a6f074e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:08.215933 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-20676d04-354b-4f5f-917c-32164a6f074e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:08.217369 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-20676d04-354b-4f5f-917c-32164a6f074e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:08.225619 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-20676d04-354b-4f5f-917c-32164a6f074e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1724 microversion: 2.20 time: 0.730386 Sep 05 12:35:08.228473 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 385/788] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:07 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1724 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:08.454428 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-b75c549d-e622-4d88-bf9e-faf5d16e085e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:08.461404 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-b75c549d-e622-4d88-bf9e-faf5d16e085e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1266 microversion: 2.1 time: 0.335073 Sep 05 12:35:08.461998 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 404/789] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:08 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1266 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:08.690683 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a153fd8c-5759-4ec7-a94e-6b461a795372 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:08.692226 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a153fd8c-5759-4ec7-a94e-6b461a795372 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:08.701346 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a153fd8c-5759-4ec7-a94e-6b461a795372 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:08.702123 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a153fd8c-5759-4ec7-a94e-6b461a795372 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:08.702705 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a153fd8c-5759-4ec7-a94e-6b461a795372 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:08.703631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a153fd8c-5759-4ec7-a94e-6b461a795372 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:08.704639 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a153fd8c-5759-4ec7-a94e-6b461a795372 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:08.705854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a153fd8c-5759-4ec7-a94e-6b461a795372 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:08.876214 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a153fd8c-5759-4ec7-a94e-6b461a795372 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:08.887393 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a153fd8c-5759-4ec7-a94e-6b461a795372 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5" status: 200 len: 1367 microversion: 2.1 time: 0.200641 Sep 05 12:35:08.888286 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 386/790] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:08 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:09.017094 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-a81eed9b-e28f-4295-a52a-55982508b875 req-73b2e68d-5754-45e3-9961-80ee9fd603bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d037f32-c2bd-4f5e-b99c-de3857df58a5", "tag": "4cd18a9b-7ea9-4a20-8908-c317397696cf"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:35:09.053662 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-a81eed9b-e28f-4295-a52a-55982508b875 req-73b2e68d-5754-45e3-9961-80ee9fd603bc service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:09.057460 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-a81eed9b-e28f-4295-a52a-55982508b875 req-73b2e68d-5754-45e3-9961-80ee9fd603bc service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:09.059812 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-a81eed9b-e28f-4295-a52a-55982508b875 req-73b2e68d-5754-45e3-9961-80ee9fd603bc service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:09.080997 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-a81eed9b-e28f-4295-a52a-55982508b875 req-73b2e68d-5754-45e3-9961-80ee9fd603bc service nova] Creating event network-changed:4cd18a9b-7ea9-4a20-8908-c317397696cf for instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 on hv-cinder-80135 Sep 05 12:35:09.087873 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-a81eed9b-e28f-4295-a52a-55982508b875 req-73b2e68d-5754-45e3-9961-80ee9fd603bc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074668 Sep 05 12:35:09.088836 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 405/791] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:35:09.270978 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-5acf1913-9b4d-43a1-bfe2-1f7803c26c0a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:09.271941 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-5acf1913-9b4d-43a1-bfe2-1f7803c26c0a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:09.282962 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5acf1913-9b4d-43a1-bfe2-1f7803c26c0a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:09.282962 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5acf1913-9b4d-43a1-bfe2-1f7803c26c0a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:09.282962 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5acf1913-9b4d-43a1-bfe2-1f7803c26c0a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:09.282962 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5acf1913-9b4d-43a1-bfe2-1f7803c26c0a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:09.283285 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5acf1913-9b4d-43a1-bfe2-1f7803c26c0a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:09.283285 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5acf1913-9b4d-43a1-bfe2-1f7803c26c0a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:09.490353 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4c0bca17-7cd2-4d80-b699-e05cf832085c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:09.491754 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4c0bca17-7cd2-4d80-b699-e05cf832085c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:09.498423 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4c0bca17-7cd2-4d80-b699-e05cf832085c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:09.499136 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4c0bca17-7cd2-4d80-b699-e05cf832085c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:09.499782 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4c0bca17-7cd2-4d80-b699-e05cf832085c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:09.500697 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4c0bca17-7cd2-4d80-b699-e05cf832085c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:09.501315 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4c0bca17-7cd2-4d80-b699-e05cf832085c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:09.501895 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4c0bca17-7cd2-4d80-b699-e05cf832085c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:09.546066 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-5acf1913-9b4d-43a1-bfe2-1f7803c26c0a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:09.557575 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-5acf1913-9b4d-43a1-bfe2-1f7803c26c0a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:09.559091 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-5acf1913-9b4d-43a1-bfe2-1f7803c26c0a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:09.560459 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-5acf1913-9b4d-43a1-bfe2-1f7803c26c0a tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1724 microversion: 2.20 time: 0.293750 Sep 05 12:35:09.561737 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 387/792] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:09 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:09.770453 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-4c0bca17-7cd2-4d80-b699-e05cf832085c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:09.778620 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4c0bca17-7cd2-4d80-b699-e05cf832085c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1266 microversion: 2.1 time: 0.295935 Sep 05 12:35:09.779282 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 406/793] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:09 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1266 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:35:09.911891 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a63ee763-1bb9-45da-82ff-64aa4e7d4b85 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:09.912631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a63ee763-1bb9-45da-82ff-64aa4e7d4b85 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:09.921105 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a63ee763-1bb9-45da-82ff-64aa4e7d4b85 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:09.921890 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a63ee763-1bb9-45da-82ff-64aa4e7d4b85 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:09.922676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a63ee763-1bb9-45da-82ff-64aa4e7d4b85 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:09.923451 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a63ee763-1bb9-45da-82ff-64aa4e7d4b85 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:09.923972 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a63ee763-1bb9-45da-82ff-64aa4e7d4b85 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:09.924396 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a63ee763-1bb9-45da-82ff-64aa4e7d4b85 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:10.178105 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a63ee763-1bb9-45da-82ff-64aa4e7d4b85 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:10.186680 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a63ee763-1bb9-45da-82ff-64aa4e7d4b85 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5" status: 200 len: 1367 microversion: 2.1 time: 0.278864 Sep 05 12:35:10.187528 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 388/794] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:09 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:10.586982 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c06fe053-d0cc-4bcc-84b7-549d3095f897 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:10.587585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-c06fe053-d0cc-4bcc-84b7-549d3095f897 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:10.593931 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c06fe053-d0cc-4bcc-84b7-549d3095f897 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:10.594404 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c06fe053-d0cc-4bcc-84b7-549d3095f897 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:10.594841 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c06fe053-d0cc-4bcc-84b7-549d3095f897 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:10.595664 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c06fe053-d0cc-4bcc-84b7-549d3095f897 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:10.596680 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c06fe053-d0cc-4bcc-84b7-549d3095f897 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:10.597062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c06fe053-d0cc-4bcc-84b7-549d3095f897 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:10.735399 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c06fe053-d0cc-4bcc-84b7-549d3095f897 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:10.744706 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c06fe053-d0cc-4bcc-84b7-549d3095f897 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:10.746168 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c06fe053-d0cc-4bcc-84b7-549d3095f897 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:10.747828 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-c06fe053-d0cc-4bcc-84b7-549d3095f897 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1724 microversion: 2.20 time: 0.164800 Sep 05 12:35:10.748386 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 407/795] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:10 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:10.805144 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-25ea45de-c17f-48a6-8f9f-5a7dca20f40d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:10.805892 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-25ea45de-c17f-48a6-8f9f-5a7dca20f40d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:10.812498 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-25ea45de-c17f-48a6-8f9f-5a7dca20f40d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:10.813043 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-25ea45de-c17f-48a6-8f9f-5a7dca20f40d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:10.813706 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-25ea45de-c17f-48a6-8f9f-5a7dca20f40d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:10.814423 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-25ea45de-c17f-48a6-8f9f-5a7dca20f40d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:10.815372 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-25ea45de-c17f-48a6-8f9f-5a7dca20f40d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:10.815818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-25ea45de-c17f-48a6-8f9f-5a7dca20f40d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:10.840944 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0261262a-bfca-4aa6-bdb4-a42becb7af81 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-320942451"}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:35:10.840944 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0261262a-bfca-4aa6-bdb4-a42becb7af81 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:10.852137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0261262a-bfca-4aa6-bdb4-a42becb7af81 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:10.852648 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0261262a-bfca-4aa6-bdb4-a42becb7af81 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:10.853091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0261262a-bfca-4aa6-bdb4-a42becb7af81 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:10.853805 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0261262a-bfca-4aa6-bdb4-a42becb7af81 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:10.854266 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0261262a-bfca-4aa6-bdb4-a42becb7af81 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:10.854689 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0261262a-bfca-4aa6-bdb4-a42becb7af81 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:10.982000 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-25ea45de-c17f-48a6-8f9f-5a7dca20f40d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:10.992635 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-25ea45de-c17f-48a6-8f9f-5a7dca20f40d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1266 microversion: 2.1 time: 0.192042 Sep 05 12:35:11.003571 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 389/796] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:10 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:35:11.042970 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.network.security_group_api [None req-0261262a-bfca-4aa6-bdb4-a42becb7af81 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Adding security group 3533742a-a686-479f-81e8-521361f5def6 to port 484ab154-1eb7-4f51-b8a6-351d2c0646e4 Sep 05 12:35:11.210232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4d28e39a-3156-47d8-88bb-f6720fffb289 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:11.210991 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-4d28e39a-3156-47d8-88bb-f6720fffb289 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:11.223220 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d28e39a-3156-47d8-88bb-f6720fffb289 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:11.223755 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d28e39a-3156-47d8-88bb-f6720fffb289 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:11.224196 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d28e39a-3156-47d8-88bb-f6720fffb289 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:11.224936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d28e39a-3156-47d8-88bb-f6720fffb289 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:11.225423 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d28e39a-3156-47d8-88bb-f6720fffb289 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:11.225848 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d28e39a-3156-47d8-88bb-f6720fffb289 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:11.382778 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-4d28e39a-3156-47d8-88bb-f6720fffb289 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:11.391809 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-4d28e39a-3156-47d8-88bb-f6720fffb289 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5" status: 200 len: 1367 microversion: 2.1 time: 0.185412 Sep 05 12:35:11.403622 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 390/797] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:11 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:35:11.776973 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-53919b7f-ce58-414f-8fcd-8e20f4a5ce1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:11.778054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-53919b7f-ce58-414f-8fcd-8e20f4a5ce1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:11.786923 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-53919b7f-ce58-414f-8fcd-8e20f4a5ce1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:11.787563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-53919b7f-ce58-414f-8fcd-8e20f4a5ce1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:11.788145 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-53919b7f-ce58-414f-8fcd-8e20f4a5ce1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:11.789720 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-53919b7f-ce58-414f-8fcd-8e20f4a5ce1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:11.790148 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-53919b7f-ce58-414f-8fcd-8e20f4a5ce1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:11.791162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-53919b7f-ce58-414f-8fcd-8e20f4a5ce1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:11.848483 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0261262a-bfca-4aa6-bdb4-a42becb7af81 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "POST /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f/action" status: 202 len: 0 microversion: 2.1 time: 1.013829 Sep 05 12:35:11.849655 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 408/798] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Sep 5 12:35:10 2022] POST /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f/action => generated 0 bytes in 1016 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 05 12:35:11.859286 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-8ef1a2f3-ed32-4456-9d6c-356747221ea5 req-a86d52a8-c6be-4ac8-834e-ec857b1c5c63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8aa06a-9ac0-41d2-93ba-ae42895d418f", "tag": "484ab154-1eb7-4f51-b8a6-351d2c0646e4"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:35:11.871507 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-8ef1a2f3-ed32-4456-9d6c-356747221ea5 req-a86d52a8-c6be-4ac8-834e-ec857b1c5c63 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:11.872375 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-8ef1a2f3-ed32-4456-9d6c-356747221ea5 req-a86d52a8-c6be-4ac8-834e-ec857b1c5c63 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:11.873009 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-8ef1a2f3-ed32-4456-9d6c-356747221ea5 req-a86d52a8-c6be-4ac8-834e-ec857b1c5c63 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:11.887072 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-8ef1a2f3-ed32-4456-9d6c-356747221ea5 req-a86d52a8-c6be-4ac8-834e-ec857b1c5c63 service nova] Creating event network-changed:484ab154-1eb7-4f51-b8a6-351d2c0646e4 for instance 7a8aa06a-9ac0-41d2-93ba-ae42895d418f on hv-cinder-80135 Sep 05 12:35:11.892974 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-8ef1a2f3-ed32-4456-9d6c-356747221ea5 req-a86d52a8-c6be-4ac8-834e-ec857b1c5c63 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038540 Sep 05 12:35:11.896249 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 409/799] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:35:11.902207 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0bdfb904-2fdb-49b8-9b27-b6fb85abcc76 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:11.903029 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0bdfb904-2fdb-49b8-9b27-b6fb85abcc76 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:11.910515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0bdfb904-2fdb-49b8-9b27-b6fb85abcc76 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:11.911254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0bdfb904-2fdb-49b8-9b27-b6fb85abcc76 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:11.912036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0bdfb904-2fdb-49b8-9b27-b6fb85abcc76 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:11.912925 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0bdfb904-2fdb-49b8-9b27-b6fb85abcc76 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:11.913404 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0bdfb904-2fdb-49b8-9b27-b6fb85abcc76 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:11.913817 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0bdfb904-2fdb-49b8-9b27-b6fb85abcc76 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:12.001319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-53919b7f-ce58-414f-8fcd-8e20f4a5ce1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:12.007704 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-53919b7f-ce58-414f-8fcd-8e20f4a5ce1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:12.009230 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-53919b7f-ce58-414f-8fcd-8e20f4a5ce1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:12.010688 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-53919b7f-ce58-414f-8fcd-8e20f4a5ce1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1724 microversion: 2.20 time: 0.240005 Sep 05 12:35:12.011428 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 391/800] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:11 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:35:12.016614 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-9bfc147f-eb46-495f-ae94-692a8d9ff20e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:12.017554 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-9bfc147f-eb46-495f-ae94-692a8d9ff20e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:12.033001 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9bfc147f-eb46-495f-ae94-692a8d9ff20e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:12.035146 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9bfc147f-eb46-495f-ae94-692a8d9ff20e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:12.036322 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9bfc147f-eb46-495f-ae94-692a8d9ff20e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:12.037598 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9bfc147f-eb46-495f-ae94-692a8d9ff20e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:12.038324 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9bfc147f-eb46-495f-ae94-692a8d9ff20e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:12.038891 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9bfc147f-eb46-495f-ae94-692a8d9ff20e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:12.254460 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-9bfc147f-eb46-495f-ae94-692a8d9ff20e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:12.268945 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-9bfc147f-eb46-495f-ae94-692a8d9ff20e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1266 microversion: 2.1 time: 0.255006 Sep 05 12:35:12.271264 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 392/801] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:12 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:12.416271 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-10af3db9-8701-4261-b370-83521ce93cdf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:12.418117 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-10af3db9-8701-4261-b370-83521ce93cdf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:12.426079 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-10af3db9-8701-4261-b370-83521ce93cdf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:12.426818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-10af3db9-8701-4261-b370-83521ce93cdf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:12.427950 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-10af3db9-8701-4261-b370-83521ce93cdf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:12.428385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-10af3db9-8701-4261-b370-83521ce93cdf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:12.429830 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-10af3db9-8701-4261-b370-83521ce93cdf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:12.430454 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-10af3db9-8701-4261-b370-83521ce93cdf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:12.445300 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0bdfb904-2fdb-49b8-9b27-b6fb85abcc76 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:12.454531 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0bdfb904-2fdb-49b8-9b27-b6fb85abcc76 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1758 microversion: 2.1 time: 0.556774 Sep 05 12:35:12.455126 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 410/802] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:11 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1758 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:12.629865 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-10af3db9-8701-4261-b370-83521ce93cdf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:12.639270 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-10af3db9-8701-4261-b370-83521ce93cdf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5" status: 200 len: 1367 microversion: 2.1 time: 0.227652 Sep 05 12:35:12.640648 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 393/803] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:12 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:35:13.038115 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8dcbd587-b559-41b5-a76c-27f129525105 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:13.038723 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-8dcbd587-b559-41b5-a76c-27f129525105 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:13.040733 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=2 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:13.041433 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=6 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:13.046865 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8dcbd587-b559-41b5-a76c-27f129525105 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:13.047358 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8dcbd587-b559-41b5-a76c-27f129525105 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:13.047816 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8dcbd587-b559-41b5-a76c-27f129525105 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:13.048708 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8dcbd587-b559-41b5-a76c-27f129525105 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:13.049279 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8dcbd587-b559-41b5-a76c-27f129525105 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:13.049709 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8dcbd587-b559-41b5-a76c-27f129525105 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:13.054775 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=100 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:13.193506 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-8dcbd587-b559-41b5-a76c-27f129525105 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:13.201888 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-8dcbd587-b559-41b5-a76c-27f129525105 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:13.203336 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-8dcbd587-b559-41b5-a76c-27f129525105 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:13.204544 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-8dcbd587-b559-41b5-a76c-27f129525105 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1724 microversion: 2.20 time: 0.170831 Sep 05 12:35:13.205100 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 411/804] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:13 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:13.292472 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-6543df2f-a33e-497f-91c8-d7b94f6851ef tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:13.293182 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-6543df2f-a33e-497f-91c8-d7b94f6851ef tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:13.295190 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=6 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:13.296507 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:13.301381 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6543df2f-a33e-497f-91c8-d7b94f6851ef tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:13.301888 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6543df2f-a33e-497f-91c8-d7b94f6851ef tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:13.305762 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6543df2f-a33e-497f-91c8-d7b94f6851ef tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:13.305762 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6543df2f-a33e-497f-91c8-d7b94f6851ef tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:13.305762 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6543df2f-a33e-497f-91c8-d7b94f6851ef tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:13.305762 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6543df2f-a33e-497f-91c8-d7b94f6851ef tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:13.462964 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6543df2f-a33e-497f-91c8-d7b94f6851ef tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:13.465420 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=100 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:13.472691 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-6543df2f-a33e-497f-91c8-d7b94f6851ef tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1266 microversion: 2.1 time: 0.184142 Sep 05 12:35:13.473299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 394/805] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:13 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:13.662314 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d34f441a-1995-459b-94a0-35cac325026d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:13.662930 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d34f441a-1995-459b-94a0-35cac325026d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:13.669068 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d34f441a-1995-459b-94a0-35cac325026d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:13.669564 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d34f441a-1995-459b-94a0-35cac325026d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:13.670037 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d34f441a-1995-459b-94a0-35cac325026d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:13.670739 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d34f441a-1995-459b-94a0-35cac325026d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:13.671199 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d34f441a-1995-459b-94a0-35cac325026d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:13.671657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d34f441a-1995-459b-94a0-35cac325026d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:13.847053 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d34f441a-1995-459b-94a0-35cac325026d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:13.871219 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d34f441a-1995-459b-94a0-35cac325026d tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5" status: 200 len: 1367 microversion: 2.1 time: 0.212699 Sep 05 12:35:13.871934 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 412/806] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:13 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:13.925555 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-c23db145-7616-4cd3-9082-c02f6ae416fd req-2059b92a-647e-456f-9c7d-de50cd84976c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d037f32-c2bd-4f5e-b99c-de3857df58a5", "name": "network-vif-plugged", "status": "completed", "tag": "4cd18a9b-7ea9-4a20-8908-c317397696cf"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:35:13.935827 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-c23db145-7616-4cd3-9082-c02f6ae416fd req-2059b92a-647e-456f-9c7d-de50cd84976c service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:13.936306 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-c23db145-7616-4cd3-9082-c02f6ae416fd req-2059b92a-647e-456f-9c7d-de50cd84976c service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:13.936772 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-c23db145-7616-4cd3-9082-c02f6ae416fd req-2059b92a-647e-456f-9c7d-de50cd84976c service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:13.949382 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-c23db145-7616-4cd3-9082-c02f6ae416fd req-2059b92a-647e-456f-9c7d-de50cd84976c service nova] Creating event network-vif-plugged:4cd18a9b-7ea9-4a20-8908-c317397696cf for instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 on hv-cinder-80135 Sep 05 12:35:13.954646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-c23db145-7616-4cd3-9082-c02f6ae416fd req-2059b92a-647e-456f-9c7d-de50cd84976c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232880 Sep 05 12:35:13.955297 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 395/807] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:35:14.234757 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-35d227b5-6722-417c-b28b-8b1638242a23 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:14.235432 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-35d227b5-6722-417c-b28b-8b1638242a23 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:14.243311 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-35d227b5-6722-417c-b28b-8b1638242a23 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:14.243840 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-35d227b5-6722-417c-b28b-8b1638242a23 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:14.244283 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-35d227b5-6722-417c-b28b-8b1638242a23 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:14.244981 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-35d227b5-6722-417c-b28b-8b1638242a23 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:14.245623 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-35d227b5-6722-417c-b28b-8b1638242a23 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:14.246052 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-35d227b5-6722-417c-b28b-8b1638242a23 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:14.435595 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-35d227b5-6722-417c-b28b-8b1638242a23 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:14.444672 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-35d227b5-6722-417c-b28b-8b1638242a23 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:14.446604 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-35d227b5-6722-417c-b28b-8b1638242a23 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:14.447372 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-35d227b5-6722-417c-b28b-8b1638242a23 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1724 microversion: 2.20 time: 0.220617 Sep 05 12:35:14.447961 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 413/808] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:14 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:14.497583 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-16a6335a-5fe7-494f-b4d9-8ec55763f185 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:14.498280 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-16a6335a-5fe7-494f-b4d9-8ec55763f185 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:14.504715 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-16a6335a-5fe7-494f-b4d9-8ec55763f185 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:14.505205 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-16a6335a-5fe7-494f-b4d9-8ec55763f185 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:14.505635 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-16a6335a-5fe7-494f-b4d9-8ec55763f185 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:14.506334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-16a6335a-5fe7-494f-b4d9-8ec55763f185 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:14.506785 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-16a6335a-5fe7-494f-b4d9-8ec55763f185 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:14.507207 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-16a6335a-5fe7-494f-b4d9-8ec55763f185 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:14.647591 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-16a6335a-5fe7-494f-b4d9-8ec55763f185 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:14.656280 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-16a6335a-5fe7-494f-b4d9-8ec55763f185 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1266 microversion: 2.1 time: 0.163314 Sep 05 12:35:14.657065 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 396/809] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:14 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:14.884151 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-fc54329e-21ee-49b0-94f9-7443b6ddb28f tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] Calling method '.version_select at 0x7fe7128ad310>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:14.895044 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-b98d2d76-e2c9-4814-a759-4df1604a2d67 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:14.895777 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-b98d2d76-e2c9-4814-a759-4df1604a2d67 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:14.902081 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b98d2d76-e2c9-4814-a759-4df1604a2d67 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:14.902652 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b98d2d76-e2c9-4814-a759-4df1604a2d67 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:14.903180 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b98d2d76-e2c9-4814-a759-4df1604a2d67 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:14.904018 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b98d2d76-e2c9-4814-a759-4df1604a2d67 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:14.904544 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b98d2d76-e2c9-4814-a759-4df1604a2d67 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:14.905036 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b98d2d76-e2c9-4814-a759-4df1604a2d67 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:14.934116 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-fc54329e-21ee-49b0-94f9-7443b6ddb28f tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/f3a3aa77-e6af-412a-b898-38fea6d0f683" status: 200 len: 350 microversion: 2.1 time: 0.053978 Sep 05 12:35:14.934873 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 414/810] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Sep 5 12:35:14 2022] GET /compute/v2.1/os-volumes/f3a3aa77-e6af-412a-b898-38fea6d0f683 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:35:15.066503 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-b98d2d76-e2c9-4814-a759-4df1604a2d67 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:15.074393 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-b98d2d76-e2c9-4814-a759-4df1604a2d67 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5" status: 200 len: 1367 microversion: 2.1 time: 0.183980 Sep 05 12:35:15.074984 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 397/811] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:14 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:35:15.474423 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-40c23bf8-8a18-4d9b-9ae7-abeae43178e2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:15.475043 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-40c23bf8-8a18-4d9b-9ae7-abeae43178e2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:15.483854 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-40c23bf8-8a18-4d9b-9ae7-abeae43178e2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:15.487297 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-40c23bf8-8a18-4d9b-9ae7-abeae43178e2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:15.487850 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-40c23bf8-8a18-4d9b-9ae7-abeae43178e2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:15.488836 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-40c23bf8-8a18-4d9b-9ae7-abeae43178e2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:15.489286 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-40c23bf8-8a18-4d9b-9ae7-abeae43178e2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:15.489881 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-40c23bf8-8a18-4d9b-9ae7-abeae43178e2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:15.668979 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-40c23bf8-8a18-4d9b-9ae7-abeae43178e2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:15.678502 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-40c23bf8-8a18-4d9b-9ae7-abeae43178e2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:15.680004 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-40c23bf8-8a18-4d9b-9ae7-abeae43178e2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:15.680200 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d1e228f0-0568-4db3-be3e-03b57df7ec60 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:15.680820 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d1e228f0-0568-4db3-be3e-03b57df7ec60 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:15.682197 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-40c23bf8-8a18-4d9b-9ae7-abeae43178e2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1724 microversion: 2.20 time: 0.212095 Sep 05 12:35:15.682774 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 415/812] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:15 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:15.687465 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d1e228f0-0568-4db3-be3e-03b57df7ec60 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:15.687986 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d1e228f0-0568-4db3-be3e-03b57df7ec60 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:15.688604 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d1e228f0-0568-4db3-be3e-03b57df7ec60 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:15.689308 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d1e228f0-0568-4db3-be3e-03b57df7ec60 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:15.690889 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d1e228f0-0568-4db3-be3e-03b57df7ec60 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:15.690889 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d1e228f0-0568-4db3-be3e-03b57df7ec60 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:15.834026 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d1e228f0-0568-4db3-be3e-03b57df7ec60 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:15.840435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d1e228f0-0568-4db3-be3e-03b57df7ec60 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1266 microversion: 2.1 time: 0.164198 Sep 05 12:35:15.841105 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 398/813] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:15 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:15.970512 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-3e59d4c8-4521-46a8-a401-fd2988a15097 req-b21b3396-59f7-4c75-b440-cf2f2dfd9f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ca1300-109c-4625-a6f9-f7094055e384", "name": "network-vif-plugged", "status": "completed", "tag": "d439ecff-d56e-4259-b799-38d86dccd75f"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:35:15.980384 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-3e59d4c8-4521-46a8-a401-fd2988a15097 req-b21b3396-59f7-4c75-b440-cf2f2dfd9f64 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:15.981139 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-3e59d4c8-4521-46a8-a401-fd2988a15097 req-b21b3396-59f7-4c75-b440-cf2f2dfd9f64 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:15.981577 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-3e59d4c8-4521-46a8-a401-fd2988a15097 req-b21b3396-59f7-4c75-b440-cf2f2dfd9f64 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:15.995069 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-3e59d4c8-4521-46a8-a401-fd2988a15097 req-b21b3396-59f7-4c75-b440-cf2f2dfd9f64 service nova] Creating event network-vif-plugged:d439ecff-d56e-4259-b799-38d86dccd75f for instance 96ca1300-109c-4625-a6f9-f7094055e384 on hv-cinder-80135 Sep 05 12:35:16.000417 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-3e59d4c8-4521-46a8-a401-fd2988a15097 req-b21b3396-59f7-4c75-b440-cf2f2dfd9f64 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033634 Sep 05 12:35:16.001215 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 416/814] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:35:16.097967 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-cec70b73-6496-46b6-84cf-2290b4d1b527 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:16.098582 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-cec70b73-6496-46b6-84cf-2290b4d1b527 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:16.107271 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cec70b73-6496-46b6-84cf-2290b4d1b527 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:16.107791 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cec70b73-6496-46b6-84cf-2290b4d1b527 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:16.108225 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cec70b73-6496-46b6-84cf-2290b4d1b527 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:16.108950 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cec70b73-6496-46b6-84cf-2290b4d1b527 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:16.109400 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cec70b73-6496-46b6-84cf-2290b4d1b527 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:16.109818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cec70b73-6496-46b6-84cf-2290b4d1b527 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:16.256285 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-cec70b73-6496-46b6-84cf-2290b4d1b527 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:16.267862 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-cec70b73-6496-46b6-84cf-2290b4d1b527 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5" status: 200 len: 1367 microversion: 2.1 time: 0.170467 Sep 05 12:35:16.267862 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 399/815] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:16 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:16.654781 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7676fe22-3ced-4325-bc78-b784d3f17b04 tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] Calling method '.version_select at 0x7fe712869ca0>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:16.702471 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-7676fe22-3ced-4325-bc78-b784d3f17b04 tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/931b123b-bc31-4997-b307-cfbe2680deb5" status: 200 len: 351 microversion: 2.1 time: 0.052268 Sep 05 12:35:16.703041 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 417/816] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Sep 5 12:35:16 2022] GET /compute/v2.1/os-volumes/931b123b-bc31-4997-b307-cfbe2680deb5 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:35:16.710901 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a60c1a07-96ec-428c-b2ab-bdb0d4630f7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:16.711514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a60c1a07-96ec-428c-b2ab-bdb0d4630f7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:16.718499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a60c1a07-96ec-428c-b2ab-bdb0d4630f7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:16.720114 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a60c1a07-96ec-428c-b2ab-bdb0d4630f7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:16.720524 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a60c1a07-96ec-428c-b2ab-bdb0d4630f7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:16.721775 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a60c1a07-96ec-428c-b2ab-bdb0d4630f7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:16.722232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a60c1a07-96ec-428c-b2ab-bdb0d4630f7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:16.722654 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a60c1a07-96ec-428c-b2ab-bdb0d4630f7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:16.865179 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d0764041-2add-4a6c-8511-9f5b9910c674 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:16.865981 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d0764041-2add-4a6c-8511-9f5b9910c674 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:16.872969 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d0764041-2add-4a6c-8511-9f5b9910c674 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:16.873468 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d0764041-2add-4a6c-8511-9f5b9910c674 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:16.875069 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d0764041-2add-4a6c-8511-9f5b9910c674 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:16.875069 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d0764041-2add-4a6c-8511-9f5b9910c674 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:16.875069 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d0764041-2add-4a6c-8511-9f5b9910c674 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:16.875477 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d0764041-2add-4a6c-8511-9f5b9910c674 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:17.016832 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d0764041-2add-4a6c-8511-9f5b9910c674 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:17.025912 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d0764041-2add-4a6c-8511-9f5b9910c674 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1266 microversion: 2.1 time: 0.165838 Sep 05 12:35:17.026837 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 418/817] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:16 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:35:17.032788 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a60c1a07-96ec-428c-b2ab-bdb0d4630f7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:17.042449 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a60c1a07-96ec-428c-b2ab-bdb0d4630f7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:17.043976 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a60c1a07-96ec-428c-b2ab-bdb0d4630f7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:17.058338 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a60c1a07-96ec-428c-b2ab-bdb0d4630f7c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1724 microversion: 2.20 time: 0.338444 Sep 05 12:35:17.058338 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 400/818] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:16 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1724 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:17.288746 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-77938bbf-93ea-4f7a-99a4-33f22b6b44bf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:17.289159 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-77938bbf-93ea-4f7a-99a4-33f22b6b44bf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:17.295292 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-77938bbf-93ea-4f7a-99a4-33f22b6b44bf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:17.295874 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-77938bbf-93ea-4f7a-99a4-33f22b6b44bf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:17.296360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-77938bbf-93ea-4f7a-99a4-33f22b6b44bf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:17.297063 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-77938bbf-93ea-4f7a-99a4-33f22b6b44bf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:17.297513 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-77938bbf-93ea-4f7a-99a4-33f22b6b44bf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:17.298010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-77938bbf-93ea-4f7a-99a4-33f22b6b44bf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:17.435277 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-77938bbf-93ea-4f7a-99a4-33f22b6b44bf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:17.443849 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-77938bbf-93ea-4f7a-99a4-33f22b6b44bf tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5" status: 200 len: 1557 microversion: 2.1 time: 0.159138 Sep 05 12:35:17.444431 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 419/819] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:17 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:17.466848 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-9f31a1de-8bfb-4e42-a1cc-bb3d85980292 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:17.467346 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-9f31a1de-8bfb-4e42-a1cc-bb3d85980292 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:17.473826 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9f31a1de-8bfb-4e42-a1cc-bb3d85980292 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:17.474321 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9f31a1de-8bfb-4e42-a1cc-bb3d85980292 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:17.474751 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9f31a1de-8bfb-4e42-a1cc-bb3d85980292 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:17.475466 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9f31a1de-8bfb-4e42-a1cc-bb3d85980292 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:17.476051 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9f31a1de-8bfb-4e42-a1cc-bb3d85980292 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:17.476469 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9f31a1de-8bfb-4e42-a1cc-bb3d85980292 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:17.555760 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-9f31a1de-8bfb-4e42-a1cc-bb3d85980292 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092926 Sep 05 12:35:17.556325 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 401/820] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Sep 5 12:35:17 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:35:18.052233 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-bc873323-5d34-4424-821f-7d7f714e5c96 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:18.053335 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-bc873323-5d34-4424-821f-7d7f714e5c96 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:18.060279 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bc873323-5d34-4424-821f-7d7f714e5c96 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:18.060763 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bc873323-5d34-4424-821f-7d7f714e5c96 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:18.061198 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bc873323-5d34-4424-821f-7d7f714e5c96 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:18.061904 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bc873323-5d34-4424-821f-7d7f714e5c96 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:18.062385 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bc873323-5d34-4424-821f-7d7f714e5c96 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:18.062814 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bc873323-5d34-4424-821f-7d7f714e5c96 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:18.072582 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-07c84dda-b7f1-4a2e-afad-61fb19515fe4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:18.076686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-07c84dda-b7f1-4a2e-afad-61fb19515fe4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:18.079473 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-07c84dda-b7f1-4a2e-afad-61fb19515fe4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:18.079999 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-07c84dda-b7f1-4a2e-afad-61fb19515fe4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:18.080970 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-07c84dda-b7f1-4a2e-afad-61fb19515fe4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:18.081733 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-07c84dda-b7f1-4a2e-afad-61fb19515fe4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:18.082187 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-07c84dda-b7f1-4a2e-afad-61fb19515fe4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:18.082613 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-07c84dda-b7f1-4a2e-afad-61fb19515fe4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:18.218108 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-bc873323-5d34-4424-821f-7d7f714e5c96 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:18.226846 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-bc873323-5d34-4424-821f-7d7f714e5c96 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1453 microversion: 2.1 time: 0.180904 Sep 05 12:35:18.227446 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 420/821] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:18 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1453 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:18.254677 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e7de2ad3-0534-4313-a597-facafa7c7a2c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:18.255341 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e7de2ad3-0534-4313-a597-facafa7c7a2c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:18.262070 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e7de2ad3-0534-4313-a597-facafa7c7a2c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:18.262565 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e7de2ad3-0534-4313-a597-facafa7c7a2c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:18.263036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e7de2ad3-0534-4313-a597-facafa7c7a2c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:18.263775 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e7de2ad3-0534-4313-a597-facafa7c7a2c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:18.264238 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e7de2ad3-0534-4313-a597-facafa7c7a2c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:18.264674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e7de2ad3-0534-4313-a597-facafa7c7a2c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:18.409929 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e7de2ad3-0534-4313-a597-facafa7c7a2c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:18.418043 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e7de2ad3-0534-4313-a597-facafa7c7a2c tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1453 microversion: 2.1 time: 0.167833 Sep 05 12:35:18.418609 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 421/822] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:18 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:35:18.428882 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-28966a36-22d4-4c16-9f73-a9bf959ee6ab tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] Calling method '.version_select at 0x7fe7127fb280>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:18.491700 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-28966a36-22d4-4c16-9f73-a9bf959ee6ab tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/5f193d0a-7d8c-4bfb-8c41-1de6274bc257" status: 200 len: 351 microversion: 2.1 time: 0.071951 Sep 05 12:35:18.492496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 422/823] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Sep 5 12:35:18 2022] GET /compute/v2.1/os-volumes/5f193d0a-7d8c-4bfb-8c41-1de6274bc257 => generated 351 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:35:18.507502 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-b60b88d6-3d2a-4e18-a99a-854ade021284 tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] Calling method '.version_select at 0x7fe712838e50>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:18.595069 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-b60b88d6-3d2a-4e18-a99a-854ade021284 tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.093134 Sep 05 12:35:18.605522 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 423/824] 10.222.0.62 () {58 vars in 1134 bytes} [Mon Sep 5 12:35:18 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:35:18.605749 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-07c84dda-b7f1-4a2e-afad-61fb19515fe4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:18.612746 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-11939698-9a7e-4365-b634-4be82d33faef tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] Calling method '.version_select at 0x7fe7127f1040>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:18.614285 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-07c84dda-b7f1-4a2e-afad-61fb19515fe4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:18.616059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-07c84dda-b7f1-4a2e-afad-61fb19515fe4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:18.617441 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-07c84dda-b7f1-4a2e-afad-61fb19515fe4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1745 microversion: 2.20 time: 0.549997 Sep 05 12:35:18.618565 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 402/825] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:18 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1745 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:35:18.713995 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-11939698-9a7e-4365-b634-4be82d33faef tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.107002 Sep 05 12:35:18.714891 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 424/826] 10.222.0.62 () {58 vars in 1149 bytes} [Mon Sep 5 12:35:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:35:18.729639 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-cb337d65-ae0d-4c83-8704-3ccd4726ebdc tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] Calling method '.version_select at 0x7fe71294f1f0>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:18.826118 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-cb337d65-ae0d-4c83-8704-3ccd4726ebdc tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.100199 Sep 05 12:35:18.827884 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 403/827] 10.222.0.62 () {58 vars in 1134 bytes} [Mon Sep 5 12:35:18 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:18.840097 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-b8942f1e-c58b-47fb-8a22-ae2992262c35 tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] Calling method '.version_select at 0x7fe71283b430>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:18.959426 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-b8942f1e-c58b-47fb-8a22-ae2992262c35 tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.123139 Sep 05 12:35:18.960034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 425/828] 10.222.0.62 () {58 vars in 1167 bytes} [Mon Sep 5 12:35:18 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:35:18.975458 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-cf82f698-286e-4462-967d-513ffaf7e63b tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] Calling method '.version_select at 0x7fe7127d0430>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:19.046524 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-b0819dfc-3eba-4144-955f-e2b25fda9d42 req-a89d8dbe-6976-430b-8725-1386e9ca1560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d037f32-c2bd-4f5e-b99c-de3857df58a5", "tag": "4cd18a9b-7ea9-4a20-8908-c317397696cf"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:35:19.060160 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-b0819dfc-3eba-4144-955f-e2b25fda9d42 req-a89d8dbe-6976-430b-8725-1386e9ca1560 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:19.060949 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-b0819dfc-3eba-4144-955f-e2b25fda9d42 req-a89d8dbe-6976-430b-8725-1386e9ca1560 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:19.061389 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-b0819dfc-3eba-4144-955f-e2b25fda9d42 req-a89d8dbe-6976-430b-8725-1386e9ca1560 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:19.076403 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-b0819dfc-3eba-4144-955f-e2b25fda9d42 req-a89d8dbe-6976-430b-8725-1386e9ca1560 service nova] Creating event network-changed:4cd18a9b-7ea9-4a20-8908-c317397696cf for instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 on hv-cinder-80135 Sep 05 12:35:19.079104 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-b0819dfc-3eba-4144-955f-e2b25fda9d42 req-a89d8dbe-6976-430b-8725-1386e9ca1560 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119374 Sep 05 12:35:19.079966 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 404/829] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:35:19.232993 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-cf82f698-286e-4462-967d-513ffaf7e63b tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.261953 Sep 05 12:35:19.243620 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 426/830] 10.222.0.62 () {58 vars in 1170 bytes} [Mon Sep 5 12:35:18 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:35:19.249752 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d87d0cf2-9074-432a-94ab-198bc4d93191 tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] Calling method '.version_select at 0x7fe712660790>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:19.342449 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d87d0cf2-9074-432a-94ab-198bc4d93191 tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.097594 Sep 05 12:35:19.343019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 405/831] 10.222.0.62 () {58 vars in 1155 bytes} [Mon Sep 5 12:35:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:35:19.360920 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-240d2fbf-a559-4b5a-bc30-56cbc4ddf63f tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] Calling method '.version_select at 0x7fe712838af0>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:19.455106 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-240d2fbf-a559-4b5a-bc30-56cbc4ddf63f tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.100805 Sep 05 12:35:19.457203 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 427/832] 10.222.0.62 () {58 vars in 1188 bytes} [Mon Sep 5 12:35:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:35:19.470678 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-bbec8940-aa7d-489c-9ff3-d6c7cb040112 tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] Calling method '.version_select at 0x7fe71287b670>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:19.566123 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-bbec8940-aa7d-489c-9ff3-d6c7cb040112 tempest-VolumesTestJSON-417919510 tempest-VolumesTestJSON-417919510-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.099531 Sep 05 12:35:19.566905 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 406/833] 10.222.0.62 () {58 vars in 1155 bytes} [Mon Sep 5 12:35:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:19.646097 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-73380640-f8fa-4669-846c-1385c46ad08c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:19.646494 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-73380640-f8fa-4669-846c-1385c46ad08c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:19.654515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-73380640-f8fa-4669-846c-1385c46ad08c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:19.655256 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-73380640-f8fa-4669-846c-1385c46ad08c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:19.655720 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-73380640-f8fa-4669-846c-1385c46ad08c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:19.657764 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-73380640-f8fa-4669-846c-1385c46ad08c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:19.657764 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-73380640-f8fa-4669-846c-1385c46ad08c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:19.657764 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-73380640-f8fa-4669-846c-1385c46ad08c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:19.983129 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-73380640-f8fa-4669-846c-1385c46ad08c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:19.995217 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-73380640-f8fa-4669-846c-1385c46ad08c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:19.996790 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-73380640-f8fa-4669-846c-1385c46ad08c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:19.998535 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-73380640-f8fa-4669-846c-1385c46ad08c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1745 microversion: 2.20 time: 0.357409 Sep 05 12:35:20.011562 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 428/834] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:19 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1745 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:21.026788 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-6c29d8ac-404a-4f36-9e93-a2f5d5b46feb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:21.027556 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-6c29d8ac-404a-4f36-9e93-a2f5d5b46feb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:21.034662 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6c29d8ac-404a-4f36-9e93-a2f5d5b46feb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:21.035157 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6c29d8ac-404a-4f36-9e93-a2f5d5b46feb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:21.035612 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6c29d8ac-404a-4f36-9e93-a2f5d5b46feb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:21.036330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6c29d8ac-404a-4f36-9e93-a2f5d5b46feb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:21.036779 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6c29d8ac-404a-4f36-9e93-a2f5d5b46feb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:21.037200 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6c29d8ac-404a-4f36-9e93-a2f5d5b46feb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:21.213489 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6c29d8ac-404a-4f36-9e93-a2f5d5b46feb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:21.224799 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6c29d8ac-404a-4f36-9e93-a2f5d5b46feb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:21.226651 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6c29d8ac-404a-4f36-9e93-a2f5d5b46feb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:21.227764 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-6c29d8ac-404a-4f36-9e93-a2f5d5b46feb tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1740 microversion: 2.20 time: 0.205868 Sep 05 12:35:21.228554 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 407/835] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:21 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:21.453463 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-7c3b6257-2016-435f-898b-8b984cc0f90f req-0410cd70-3639-42d7-9e30-5953b4be9cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ca1300-109c-4625-a6f9-f7094055e384", "tag": "d439ecff-d56e-4259-b799-38d86dccd75f"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:35:21.467783 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-7c3b6257-2016-435f-898b-8b984cc0f90f req-0410cd70-3639-42d7-9e30-5953b4be9cc0 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:21.468369 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-7c3b6257-2016-435f-898b-8b984cc0f90f req-0410cd70-3639-42d7-9e30-5953b4be9cc0 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:21.468593 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-7c3b6257-2016-435f-898b-8b984cc0f90f req-0410cd70-3639-42d7-9e30-5953b4be9cc0 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:21.485817 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-7c3b6257-2016-435f-898b-8b984cc0f90f req-0410cd70-3639-42d7-9e30-5953b4be9cc0 service nova] Creating event network-changed:d439ecff-d56e-4259-b799-38d86dccd75f for instance 96ca1300-109c-4625-a6f9-f7094055e384 on hv-cinder-80135 Sep 05 12:35:21.492653 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-7c3b6257-2016-435f-898b-8b984cc0f90f req-0410cd70-3639-42d7-9e30-5953b4be9cc0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042780 Sep 05 12:35:21.493731 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 429/836] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:35:21.893852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-966f4f40-4dd4-4a7d-ae6f-70bd9fcd74e9 req-54b9cd0e-2d5b-4bd6-9637-8149c4ee09fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "407e87bb-faeb-4ba6-b6dc-e9b7a3690356", "name": "network-vif-plugged", "status": "completed", "tag": "3c7003e7-309e-4432-9c69-6cc1517fcb8d"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:35:21.910822 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-966f4f40-4dd4-4a7d-ae6f-70bd9fcd74e9 req-54b9cd0e-2d5b-4bd6-9637-8149c4ee09fa service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:21.911297 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-966f4f40-4dd4-4a7d-ae6f-70bd9fcd74e9 req-54b9cd0e-2d5b-4bd6-9637-8149c4ee09fa service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:21.911769 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-966f4f40-4dd4-4a7d-ae6f-70bd9fcd74e9 req-54b9cd0e-2d5b-4bd6-9637-8149c4ee09fa service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:21.927943 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-966f4f40-4dd4-4a7d-ae6f-70bd9fcd74e9 req-54b9cd0e-2d5b-4bd6-9637-8149c4ee09fa service nova] Creating event network-vif-plugged:3c7003e7-309e-4432-9c69-6cc1517fcb8d for instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 on hv-cinder-80135 Sep 05 12:35:21.933294 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-966f4f40-4dd4-4a7d-ae6f-70bd9fcd74e9 req-54b9cd0e-2d5b-4bd6-9637-8149c4ee09fa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045316 Sep 05 12:35:21.934580 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 408/837] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:35:22.261541 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-9c096ec6-c0ed-466f-8f2f-55eee442e607 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:22.261720 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-9c096ec6-c0ed-466f-8f2f-55eee442e607 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:22.275062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9c096ec6-c0ed-466f-8f2f-55eee442e607 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:22.276539 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9c096ec6-c0ed-466f-8f2f-55eee442e607 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:22.277763 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9c096ec6-c0ed-466f-8f2f-55eee442e607 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:22.279788 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9c096ec6-c0ed-466f-8f2f-55eee442e607 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:22.280515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9c096ec6-c0ed-466f-8f2f-55eee442e607 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:22.281197 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9c096ec6-c0ed-466f-8f2f-55eee442e607 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:22.485637 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-9c096ec6-c0ed-466f-8f2f-55eee442e607 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:22.495171 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-9c096ec6-c0ed-466f-8f2f-55eee442e607 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:22.496677 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-9c096ec6-c0ed-466f-8f2f-55eee442e607 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:22.498550 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-9c096ec6-c0ed-466f-8f2f-55eee442e607 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1740 microversion: 2.20 time: 0.247311 Sep 05 12:35:22.499588 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 430/838] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:22 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:23.528266 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-2680a289-50f0-4784-a7a3-af44a1d0b962 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:23.529083 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-2680a289-50f0-4784-a7a3-af44a1d0b962 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:23.538760 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2680a289-50f0-4784-a7a3-af44a1d0b962 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:23.539328 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2680a289-50f0-4784-a7a3-af44a1d0b962 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:23.539809 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2680a289-50f0-4784-a7a3-af44a1d0b962 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:23.540534 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2680a289-50f0-4784-a7a3-af44a1d0b962 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:23.540995 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2680a289-50f0-4784-a7a3-af44a1d0b962 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:23.541422 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2680a289-50f0-4784-a7a3-af44a1d0b962 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:23.771073 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-2680a289-50f0-4784-a7a3-af44a1d0b962 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:23.791831 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-2680a289-50f0-4784-a7a3-af44a1d0b962 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:23.794391 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-2680a289-50f0-4784-a7a3-af44a1d0b962 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:23.796230 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-2680a289-50f0-4784-a7a3-af44a1d0b962 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1740 microversion: 2.20 time: 0.273440 Sep 05 12:35:23.808095 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 409/839] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:23 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1740 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:24.822759 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-2eeaf3ab-c565-4da8-a93e-64b01fe7d2f7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:24.823411 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-2eeaf3ab-c565-4da8-a93e-64b01fe7d2f7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:24.831600 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2eeaf3ab-c565-4da8-a93e-64b01fe7d2f7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:24.832149 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2eeaf3ab-c565-4da8-a93e-64b01fe7d2f7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:24.832603 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2eeaf3ab-c565-4da8-a93e-64b01fe7d2f7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:24.833332 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2eeaf3ab-c565-4da8-a93e-64b01fe7d2f7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:24.833841 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2eeaf3ab-c565-4da8-a93e-64b01fe7d2f7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:24.834290 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2eeaf3ab-c565-4da8-a93e-64b01fe7d2f7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:25.001143 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-2eeaf3ab-c565-4da8-a93e-64b01fe7d2f7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:25.012302 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-2eeaf3ab-c565-4da8-a93e-64b01fe7d2f7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:25.015025 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-2eeaf3ab-c565-4da8-a93e-64b01fe7d2f7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:25.016617 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-2eeaf3ab-c565-4da8-a93e-64b01fe7d2f7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1740 microversion: 2.20 time: 0.197821 Sep 05 12:35:25.017718 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 431/840] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:24 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:26.047789 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-bb6977d6-37c8-4d4a-afa7-64d0abbcf458 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:26.049266 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-bb6977d6-37c8-4d4a-afa7-64d0abbcf458 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:26.058659 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bb6977d6-37c8-4d4a-afa7-64d0abbcf458 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:26.059486 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bb6977d6-37c8-4d4a-afa7-64d0abbcf458 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:26.060213 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bb6977d6-37c8-4d4a-afa7-64d0abbcf458 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:26.061509 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bb6977d6-37c8-4d4a-afa7-64d0abbcf458 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:26.062480 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bb6977d6-37c8-4d4a-afa7-64d0abbcf458 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:26.064039 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bb6977d6-37c8-4d4a-afa7-64d0abbcf458 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:26.270272 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-bb6977d6-37c8-4d4a-afa7-64d0abbcf458 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:26.280148 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-bb6977d6-37c8-4d4a-afa7-64d0abbcf458 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:26.284783 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-bb6977d6-37c8-4d4a-afa7-64d0abbcf458 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:26.286273 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-bb6977d6-37c8-4d4a-afa7-64d0abbcf458 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1740 microversion: 2.20 time: 0.242790 Sep 05 12:35:26.286966 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 410/841] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:26 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1740 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:26.491195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1b33de83-7ece-4500-9586-071479e3b0ff tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:35:26.493757 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1b33de83-7ece-4500-9586-071479e3b0ff tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:26.500663 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b33de83-7ece-4500-9586-071479e3b0ff tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:26.506528 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b33de83-7ece-4500-9586-071479e3b0ff tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:26.508724 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b33de83-7ece-4500-9586-071479e3b0ff tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:26.509695 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b33de83-7ece-4500-9586-071479e3b0ff tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:26.510172 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b33de83-7ece-4500-9586-071479e3b0ff tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:26.510608 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1b33de83-7ece-4500-9586-071479e3b0ff tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:26.734966 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1b33de83-7ece-4500-9586-071479e3b0ff tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "POST /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f/action" status: 202 len: 0 microversion: 2.1 time: 0.247884 Sep 05 12:35:26.736041 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 432/842] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Sep 5 12:35:26 2022] POST /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:35:26.748700 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-6878dd9d-8455-4309-b5d1-37633c4add4d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:26.751337 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-6878dd9d-8455-4309-b5d1-37633c4add4d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:26.761868 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6878dd9d-8455-4309-b5d1-37633c4add4d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:26.762654 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6878dd9d-8455-4309-b5d1-37633c4add4d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:26.763272 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6878dd9d-8455-4309-b5d1-37633c4add4d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:26.764345 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6878dd9d-8455-4309-b5d1-37633c4add4d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:26.765508 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6878dd9d-8455-4309-b5d1-37633c4add4d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:26.766570 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6878dd9d-8455-4309-b5d1-37633c4add4d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:26.960449 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6878dd9d-8455-4309-b5d1-37633c4add4d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:26.970544 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-6878dd9d-8455-4309-b5d1-37633c4add4d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1750 microversion: 2.1 time: 0.229370 Sep 05 12:35:26.971040 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 411/843] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:26 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1750 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:27.316243 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f12d1527-2962-47c8-b298-9792daef2b7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:27.320393 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f12d1527-2962-47c8-b298-9792daef2b7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:27.332533 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f12d1527-2962-47c8-b298-9792daef2b7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:27.333325 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f12d1527-2962-47c8-b298-9792daef2b7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:27.333945 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f12d1527-2962-47c8-b298-9792daef2b7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:27.335282 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f12d1527-2962-47c8-b298-9792daef2b7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:27.344825 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f12d1527-2962-47c8-b298-9792daef2b7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:27.350527 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f12d1527-2962-47c8-b298-9792daef2b7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:27.647404 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f12d1527-2962-47c8-b298-9792daef2b7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:27.656934 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f12d1527-2962-47c8-b298-9792daef2b7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:27.658434 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f12d1527-2962-47c8-b298-9792daef2b7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:27.660541 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f12d1527-2962-47c8-b298-9792daef2b7f tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1740 microversion: 2.20 time: 0.349866 Sep 05 12:35:27.661321 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 433/844] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:27 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1740 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:27.996864 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-f0056e93-d335-48aa-b407-091e46b7b8f4 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:27.997478 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-f0056e93-d335-48aa-b407-091e46b7b8f4 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:28.005340 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f0056e93-d335-48aa-b407-091e46b7b8f4 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:28.005889 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f0056e93-d335-48aa-b407-091e46b7b8f4 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:28.006378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f0056e93-d335-48aa-b407-091e46b7b8f4 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:28.007202 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f0056e93-d335-48aa-b407-091e46b7b8f4 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:28.007738 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f0056e93-d335-48aa-b407-091e46b7b8f4 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:28.008247 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f0056e93-d335-48aa-b407-091e46b7b8f4 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:28.170352 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f0056e93-d335-48aa-b407-091e46b7b8f4 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:28.182963 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-f0056e93-d335-48aa-b407-091e46b7b8f4 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1750 microversion: 2.1 time: 0.190860 Sep 05 12:35:28.183864 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 412/845] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:27 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1750 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:28.690513 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-99f37f38-6e4d-439f-ad67-8fc08b40b2f4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:28.692175 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-99f37f38-6e4d-439f-ad67-8fc08b40b2f4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:28.705507 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-99f37f38-6e4d-439f-ad67-8fc08b40b2f4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:28.706553 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-99f37f38-6e4d-439f-ad67-8fc08b40b2f4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:28.707029 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-99f37f38-6e4d-439f-ad67-8fc08b40b2f4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:28.707765 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-99f37f38-6e4d-439f-ad67-8fc08b40b2f4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:28.708217 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-99f37f38-6e4d-439f-ad67-8fc08b40b2f4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:28.708639 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-99f37f38-6e4d-439f-ad67-8fc08b40b2f4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:28.875104 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-99f37f38-6e4d-439f-ad67-8fc08b40b2f4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:28.894431 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-99f37f38-6e4d-439f-ad67-8fc08b40b2f4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:28.898595 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-99f37f38-6e4d-439f-ad67-8fc08b40b2f4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:28.901416 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-99f37f38-6e4d-439f-ad67-8fc08b40b2f4 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1740 microversion: 2.20 time: 0.215439 Sep 05 12:35:28.903052 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 434/846] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:28 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:29.207750 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-052b7027-7563-40bd-9d5a-fba484d855fe tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:29.208371 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-052b7027-7563-40bd-9d5a-fba484d855fe tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:29.218497 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-052b7027-7563-40bd-9d5a-fba484d855fe tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:29.219267 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-052b7027-7563-40bd-9d5a-fba484d855fe tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:29.219959 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-052b7027-7563-40bd-9d5a-fba484d855fe tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:29.220681 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-052b7027-7563-40bd-9d5a-fba484d855fe tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:29.221426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-052b7027-7563-40bd-9d5a-fba484d855fe tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:29.222069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-052b7027-7563-40bd-9d5a-fba484d855fe tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:29.435244 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-052b7027-7563-40bd-9d5a-fba484d855fe tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:29.447732 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-052b7027-7563-40bd-9d5a-fba484d855fe tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1755 microversion: 2.1 time: 0.243645 Sep 05 12:35:29.448658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 413/847] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:29 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1755 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:29.936179 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-befad9e4-be06-4ffc-a834-73c781482adc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:29.936797 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-befad9e4-be06-4ffc-a834-73c781482adc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:29.944986 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-befad9e4-be06-4ffc-a834-73c781482adc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:29.945633 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-befad9e4-be06-4ffc-a834-73c781482adc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:29.946260 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-befad9e4-be06-4ffc-a834-73c781482adc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:29.947166 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-befad9e4-be06-4ffc-a834-73c781482adc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:29.947719 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-befad9e4-be06-4ffc-a834-73c781482adc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:29.948317 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-befad9e4-be06-4ffc-a834-73c781482adc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:30.129338 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-befad9e4-be06-4ffc-a834-73c781482adc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:30.140340 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-befad9e4-be06-4ffc-a834-73c781482adc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:30.142160 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-befad9e4-be06-4ffc-a834-73c781482adc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:30.143638 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-befad9e4-be06-4ffc-a834-73c781482adc tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1740 microversion: 2.20 time: 0.212151 Sep 05 12:35:30.145173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 435/848] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:29 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:30.472647 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-3f1222ad-2d50-4668-913c-863a696eeb10 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:30.475455 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-3f1222ad-2d50-4668-913c-863a696eeb10 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:30.482533 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3f1222ad-2d50-4668-913c-863a696eeb10 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:30.483016 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3f1222ad-2d50-4668-913c-863a696eeb10 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:30.483694 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3f1222ad-2d50-4668-913c-863a696eeb10 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:30.484559 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3f1222ad-2d50-4668-913c-863a696eeb10 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:30.485164 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3f1222ad-2d50-4668-913c-863a696eeb10 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:30.485741 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3f1222ad-2d50-4668-913c-863a696eeb10 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:30.680658 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-3f1222ad-2d50-4668-913c-863a696eeb10 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:30.694259 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-3f1222ad-2d50-4668-913c-863a696eeb10 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1755 microversion: 2.1 time: 0.225422 Sep 05 12:35:30.695151 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 414/849] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:30 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1755 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:31.170471 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-9c140887-8ad7-455a-b36e-3d345ebaffb7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:31.171786 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-9c140887-8ad7-455a-b36e-3d345ebaffb7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:31.179761 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9c140887-8ad7-455a-b36e-3d345ebaffb7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:31.180548 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9c140887-8ad7-455a-b36e-3d345ebaffb7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:31.181173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9c140887-8ad7-455a-b36e-3d345ebaffb7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:31.182054 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9c140887-8ad7-455a-b36e-3d345ebaffb7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:31.182819 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9c140887-8ad7-455a-b36e-3d345ebaffb7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:31.183254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9c140887-8ad7-455a-b36e-3d345ebaffb7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:31.188058 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:31.372397 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-9c140887-8ad7-455a-b36e-3d345ebaffb7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:31.381738 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-9c140887-8ad7-455a-b36e-3d345ebaffb7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:31.383574 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-9c140887-8ad7-455a-b36e-3d345ebaffb7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:31.384974 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-9c140887-8ad7-455a-b36e-3d345ebaffb7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1740 microversion: 2.20 time: 0.218361 Sep 05 12:35:31.385812 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 436/850] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:31 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:31.724504 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-caa9575f-a18b-45dc-a361-22ee8dab268a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:31.725149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-caa9575f-a18b-45dc-a361-22ee8dab268a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:31.732059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-caa9575f-a18b-45dc-a361-22ee8dab268a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:31.732549 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-caa9575f-a18b-45dc-a361-22ee8dab268a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:31.732982 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-caa9575f-a18b-45dc-a361-22ee8dab268a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:31.733689 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-caa9575f-a18b-45dc-a361-22ee8dab268a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:31.734145 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-caa9575f-a18b-45dc-a361-22ee8dab268a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:31.734569 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-caa9575f-a18b-45dc-a361-22ee8dab268a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:31.899048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-caa9575f-a18b-45dc-a361-22ee8dab268a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:31.907356 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-caa9575f-a18b-45dc-a361-22ee8dab268a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1755 microversion: 2.1 time: 0.186695 Sep 05 12:35:31.907876 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 415/851] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:31 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:35:32.418918 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-01aa08f8-be24-4226-9c57-4ceae6d33a5e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:32.420884 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-01aa08f8-be24-4226-9c57-4ceae6d33a5e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:32.432533 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-01aa08f8-be24-4226-9c57-4ceae6d33a5e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:32.433279 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-01aa08f8-be24-4226-9c57-4ceae6d33a5e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:32.433980 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-01aa08f8-be24-4226-9c57-4ceae6d33a5e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:32.434769 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-01aa08f8-be24-4226-9c57-4ceae6d33a5e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:32.435334 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-01aa08f8-be24-4226-9c57-4ceae6d33a5e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:32.437238 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-01aa08f8-be24-4226-9c57-4ceae6d33a5e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:32.619818 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-01aa08f8-be24-4226-9c57-4ceae6d33a5e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:32.629418 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-01aa08f8-be24-4226-9c57-4ceae6d33a5e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:32.631148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-01aa08f8-be24-4226-9c57-4ceae6d33a5e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:32.632568 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-01aa08f8-be24-4226-9c57-4ceae6d33a5e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1740 microversion: 2.20 time: 0.218279 Sep 05 12:35:32.633475 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 437/852] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:32 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:35:32.930804 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-33853659-6900-4c6e-8543-249e84b5700f tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:32.931416 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-33853659-6900-4c6e-8543-249e84b5700f tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:32.937911 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-33853659-6900-4c6e-8543-249e84b5700f tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:32.938325 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-33853659-6900-4c6e-8543-249e84b5700f tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:32.938758 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-33853659-6900-4c6e-8543-249e84b5700f tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:32.939446 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-33853659-6900-4c6e-8543-249e84b5700f tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:32.939942 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-33853659-6900-4c6e-8543-249e84b5700f tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:32.940936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-33853659-6900-4c6e-8543-249e84b5700f tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:33.092038 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-33853659-6900-4c6e-8543-249e84b5700f tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:33.094503 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=100 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:33.101024 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-33853659-6900-4c6e-8543-249e84b5700f tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1755 microversion: 2.1 time: 0.173999 Sep 05 12:35:33.101586 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 416/853] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:32 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:33.675425 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a59df16d-c2b5-4085-aaf5-91d43979296b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:33.683148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a59df16d-c2b5-4085-aaf5-91d43979296b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:33.683148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:33.683639 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a59df16d-c2b5-4085-aaf5-91d43979296b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:33.683743 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a59df16d-c2b5-4085-aaf5-91d43979296b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:33.684151 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a59df16d-c2b5-4085-aaf5-91d43979296b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:33.684854 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a59df16d-c2b5-4085-aaf5-91d43979296b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:33.685307 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a59df16d-c2b5-4085-aaf5-91d43979296b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:33.685728 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a59df16d-c2b5-4085-aaf5-91d43979296b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:33.832846 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a59df16d-c2b5-4085-aaf5-91d43979296b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:33.841921 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a59df16d-c2b5-4085-aaf5-91d43979296b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:33.843385 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a59df16d-c2b5-4085-aaf5-91d43979296b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:33.844596 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a59df16d-c2b5-4085-aaf5-91d43979296b tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1740 microversion: 2.20 time: 0.173187 Sep 05 12:35:33.845148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 438/854] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:33 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:34.125842 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ffd35965-8b05-4efe-b46b-2f108b3ffe7d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:34.131112 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-ffd35965-8b05-4efe-b46b-2f108b3ffe7d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:34.134064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ffd35965-8b05-4efe-b46b-2f108b3ffe7d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:34.134550 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ffd35965-8b05-4efe-b46b-2f108b3ffe7d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:34.134985 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ffd35965-8b05-4efe-b46b-2f108b3ffe7d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:34.135731 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ffd35965-8b05-4efe-b46b-2f108b3ffe7d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:34.136188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ffd35965-8b05-4efe-b46b-2f108b3ffe7d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:34.136661 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ffd35965-8b05-4efe-b46b-2f108b3ffe7d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:34.292895 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-ffd35965-8b05-4efe-b46b-2f108b3ffe7d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:34.305109 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-ffd35965-8b05-4efe-b46b-2f108b3ffe7d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1755 microversion: 2.1 time: 0.180467 Sep 05 12:35:34.305109 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 417/855] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:34 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:34.870717 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-026f1bd8-45ed-486f-9f3d-2b9b66b15775 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:34.871264 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-026f1bd8-45ed-486f-9f3d-2b9b66b15775 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:34.878257 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-026f1bd8-45ed-486f-9f3d-2b9b66b15775 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:34.878787 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-026f1bd8-45ed-486f-9f3d-2b9b66b15775 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:34.879223 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-026f1bd8-45ed-486f-9f3d-2b9b66b15775 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:34.879997 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-026f1bd8-45ed-486f-9f3d-2b9b66b15775 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:34.880451 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-026f1bd8-45ed-486f-9f3d-2b9b66b15775 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:34.880893 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-026f1bd8-45ed-486f-9f3d-2b9b66b15775 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:35.021519 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-026f1bd8-45ed-486f-9f3d-2b9b66b15775 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:35.029960 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-026f1bd8-45ed-486f-9f3d-2b9b66b15775 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:35.033025 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-026f1bd8-45ed-486f-9f3d-2b9b66b15775 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:35.035763 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-026f1bd8-45ed-486f-9f3d-2b9b66b15775 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1722 microversion: 2.20 time: 0.169127 Sep 05 12:35:35.036570 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 439/856] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:34 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:35.326404 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4fda50eb-5e8b-446f-bc16-5251eb9ca7b0 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:35.326974 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-4fda50eb-5e8b-446f-bc16-5251eb9ca7b0 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:35.333518 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4fda50eb-5e8b-446f-bc16-5251eb9ca7b0 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:35.334015 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4fda50eb-5e8b-446f-bc16-5251eb9ca7b0 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:35.334434 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4fda50eb-5e8b-446f-bc16-5251eb9ca7b0 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:35.335133 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4fda50eb-5e8b-446f-bc16-5251eb9ca7b0 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:35.335625 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4fda50eb-5e8b-446f-bc16-5251eb9ca7b0 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:35.336050 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4fda50eb-5e8b-446f-bc16-5251eb9ca7b0 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:35.480547 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-4fda50eb-5e8b-446f-bc16-5251eb9ca7b0 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:35.490373 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-4fda50eb-5e8b-446f-bc16-5251eb9ca7b0 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1755 microversion: 2.1 time: 0.167855 Sep 05 12:35:35.490957 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 418/857] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:35 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:36.065904 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0ec4ccfb-4f86-45cd-b3a4-c61a4180286e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:36.066520 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0ec4ccfb-4f86-45cd-b3a4-c61a4180286e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:36.073190 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0ec4ccfb-4f86-45cd-b3a4-c61a4180286e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:36.073678 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0ec4ccfb-4f86-45cd-b3a4-c61a4180286e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:36.074112 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0ec4ccfb-4f86-45cd-b3a4-c61a4180286e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:36.074804 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0ec4ccfb-4f86-45cd-b3a4-c61a4180286e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:36.075257 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0ec4ccfb-4f86-45cd-b3a4-c61a4180286e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:36.075980 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0ec4ccfb-4f86-45cd-b3a4-c61a4180286e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:36.219734 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0ec4ccfb-4f86-45cd-b3a4-c61a4180286e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:36.227858 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0ec4ccfb-4f86-45cd-b3a4-c61a4180286e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:36.229320 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0ec4ccfb-4f86-45cd-b3a4-c61a4180286e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:36.230520 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0ec4ccfb-4f86-45cd-b3a4-c61a4180286e tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1722 microversion: 2.20 time: 0.169502 Sep 05 12:35:36.231060 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 440/858] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:36 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:36.514388 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-61528c28-a7ab-4adf-99b0-a75d1495708d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:36.514917 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-61528c28-a7ab-4adf-99b0-a75d1495708d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:36.521980 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-61528c28-a7ab-4adf-99b0-a75d1495708d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:36.522461 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-61528c28-a7ab-4adf-99b0-a75d1495708d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:36.522886 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-61528c28-a7ab-4adf-99b0-a75d1495708d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:36.523605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-61528c28-a7ab-4adf-99b0-a75d1495708d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:36.524056 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-61528c28-a7ab-4adf-99b0-a75d1495708d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:36.524474 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-61528c28-a7ab-4adf-99b0-a75d1495708d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:36.668536 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-61528c28-a7ab-4adf-99b0-a75d1495708d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:36.676811 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-61528c28-a7ab-4adf-99b0-a75d1495708d tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1755 microversion: 2.1 time: 0.166323 Sep 05 12:35:36.677394 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 419/859] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:36 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:37.257899 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-271f27b8-df0d-4791-af15-0409b173bb65 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:37.258530 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-271f27b8-df0d-4791-af15-0409b173bb65 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:37.265118 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-271f27b8-df0d-4791-af15-0409b173bb65 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:37.265599 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-271f27b8-df0d-4791-af15-0409b173bb65 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:37.266033 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-271f27b8-df0d-4791-af15-0409b173bb65 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:37.266732 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-271f27b8-df0d-4791-af15-0409b173bb65 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:37.267184 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-271f27b8-df0d-4791-af15-0409b173bb65 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:37.267639 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-271f27b8-df0d-4791-af15-0409b173bb65 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:37.400752 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-271f27b8-df0d-4791-af15-0409b173bb65 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:37.409074 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-271f27b8-df0d-4791-af15-0409b173bb65 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:37.410525 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-271f27b8-df0d-4791-af15-0409b173bb65 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:37.411790 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-271f27b8-df0d-4791-af15-0409b173bb65 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1722 microversion: 2.20 time: 0.157857 Sep 05 12:35:37.412346 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 441/860] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:37 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:37.699990 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d443614b-2190-4279-93d9-5902b11a4613 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:37.700604 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d443614b-2190-4279-93d9-5902b11a4613 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:37.707104 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d443614b-2190-4279-93d9-5902b11a4613 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:37.707617 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d443614b-2190-4279-93d9-5902b11a4613 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:37.708053 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d443614b-2190-4279-93d9-5902b11a4613 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:37.708738 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d443614b-2190-4279-93d9-5902b11a4613 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:37.709196 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d443614b-2190-4279-93d9-5902b11a4613 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:37.709614 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d443614b-2190-4279-93d9-5902b11a4613 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:37.859036 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d443614b-2190-4279-93d9-5902b11a4613 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:37.868287 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d443614b-2190-4279-93d9-5902b11a4613 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1755 microversion: 2.1 time: 0.172097 Sep 05 12:35:37.868869 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 420/861] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:37 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:38.281404 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-157a1210-709e-4fad-9086-cc57a32a90a3 req-0132248c-af09-43ed-b9a0-37366dbc1c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "407e87bb-faeb-4ba6-b6dc-e9b7a3690356", "name": "network-vif-unplugged", "status": "completed", "tag": "3c7003e7-309e-4432-9c69-6cc1517fcb8d"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:35:38.291338 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-157a1210-709e-4fad-9086-cc57a32a90a3 req-0132248c-af09-43ed-b9a0-37366dbc1c7d service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:38.291849 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-157a1210-709e-4fad-9086-cc57a32a90a3 req-0132248c-af09-43ed-b9a0-37366dbc1c7d service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:38.292274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-157a1210-709e-4fad-9086-cc57a32a90a3 req-0132248c-af09-43ed-b9a0-37366dbc1c7d service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:38.304050 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-157a1210-709e-4fad-9086-cc57a32a90a3 req-0132248c-af09-43ed-b9a0-37366dbc1c7d service nova] Creating event network-vif-unplugged:3c7003e7-309e-4432-9c69-6cc1517fcb8d for instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 on hv-cinder-80135 Sep 05 12:35:38.308921 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-157a1210-709e-4fad-9086-cc57a32a90a3 req-0132248c-af09-43ed-b9a0-37366dbc1c7d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031296 Sep 05 12:35:38.309514 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 442/862] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:35:38.438399 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-cd1b9401-529b-45e2-be59-380a42c5e631 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:38.439120 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-cd1b9401-529b-45e2-be59-380a42c5e631 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:38.446710 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cd1b9401-529b-45e2-be59-380a42c5e631 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:38.447280 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cd1b9401-529b-45e2-be59-380a42c5e631 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:38.451843 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cd1b9401-529b-45e2-be59-380a42c5e631 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:38.451843 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cd1b9401-529b-45e2-be59-380a42c5e631 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:38.451843 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cd1b9401-529b-45e2-be59-380a42c5e631 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:38.451843 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cd1b9401-529b-45e2-be59-380a42c5e631 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:38.583048 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-cd1b9401-529b-45e2-be59-380a42c5e631 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:38.591871 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-cd1b9401-529b-45e2-be59-380a42c5e631 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:38.593341 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-cd1b9401-529b-45e2-be59-380a42c5e631 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:38.594553 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-cd1b9401-529b-45e2-be59-380a42c5e631 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1722 microversion: 2.20 time: 0.160099 Sep 05 12:35:38.595137 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 421/863] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:38 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:38.892353 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-5108eb4c-eb74-429a-a9d4-7c0f784d102e tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:38.893063 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-5108eb4c-eb74-429a-a9d4-7c0f784d102e tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:38.900065 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5108eb4c-eb74-429a-a9d4-7c0f784d102e tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:38.900548 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5108eb4c-eb74-429a-a9d4-7c0f784d102e tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:38.900974 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5108eb4c-eb74-429a-a9d4-7c0f784d102e tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:38.901671 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5108eb4c-eb74-429a-a9d4-7c0f784d102e tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:38.902120 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5108eb4c-eb74-429a-a9d4-7c0f784d102e tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:38.902551 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5108eb4c-eb74-429a-a9d4-7c0f784d102e tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:39.069509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5108eb4c-eb74-429a-a9d4-7c0f784d102e tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:39.078078 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-5108eb4c-eb74-429a-a9d4-7c0f784d102e tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1755 microversion: 2.1 time: 0.190036 Sep 05 12:35:39.078656 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 443/864] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:38 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1755 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:39.622153 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-df5f5274-0349-48dc-bd03-bee60e9b9387 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:39.622785 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-df5f5274-0349-48dc-bd03-bee60e9b9387 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:39.630070 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-df5f5274-0349-48dc-bd03-bee60e9b9387 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:39.630616 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-df5f5274-0349-48dc-bd03-bee60e9b9387 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:39.631049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-df5f5274-0349-48dc-bd03-bee60e9b9387 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:39.631774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-df5f5274-0349-48dc-bd03-bee60e9b9387 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:39.632224 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-df5f5274-0349-48dc-bd03-bee60e9b9387 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:39.632641 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-df5f5274-0349-48dc-bd03-bee60e9b9387 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:39.767007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-df5f5274-0349-48dc-bd03-bee60e9b9387 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:39.776245 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-df5f5274-0349-48dc-bd03-bee60e9b9387 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:39.777888 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-df5f5274-0349-48dc-bd03-bee60e9b9387 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:39.779047 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-df5f5274-0349-48dc-bd03-bee60e9b9387 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1665 microversion: 2.20 time: 0.161214 Sep 05 12:35:39.779621 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 422/865] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:39 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:39.808366 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d8c35633-1522-4b3a-8ecd-504b6b000194 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e8e901b-e5d1-4854-bc91-7b5c80136e66"}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:35:39.810883 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d8c35633-1522-4b3a-8ecd-504b6b000194 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:39.817882 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d8c35633-1522-4b3a-8ecd-504b6b000194 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:39.818360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d8c35633-1522-4b3a-8ecd-504b6b000194 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:39.818795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d8c35633-1522-4b3a-8ecd-504b6b000194 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:39.819509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d8c35633-1522-4b3a-8ecd-504b6b000194 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:39.820014 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d8c35633-1522-4b3a-8ecd-504b6b000194 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:39.820503 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d8c35633-1522-4b3a-8ecd-504b6b000194 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:40.104059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-65a9582f-ea22-456c-8468-fe62acbe9dcf tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:40.104676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-65a9582f-ea22-456c-8468-fe62acbe9dcf tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:40.110659 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-65a9582f-ea22-456c-8468-fe62acbe9dcf tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:40.111152 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-65a9582f-ea22-456c-8468-fe62acbe9dcf tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:40.111621 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-65a9582f-ea22-456c-8468-fe62acbe9dcf tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:40.112327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-65a9582f-ea22-456c-8468-fe62acbe9dcf tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:40.112792 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-65a9582f-ea22-456c-8468-fe62acbe9dcf tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:40.113223 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-65a9582f-ea22-456c-8468-fe62acbe9dcf tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:40.260225 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-65a9582f-ea22-456c-8468-fe62acbe9dcf tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:40.273568 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-65a9582f-ea22-456c-8468-fe62acbe9dcf tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1755 microversion: 2.1 time: 0.173286 Sep 05 12:35:40.274151 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 423/866] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:40 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:35:40.747295 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d8c35633-1522-4b3a-8ecd-504b6b000194 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "POST /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.942921 Sep 05 12:35:40.747867 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 444/867] 10.222.0.62 () {62 vars in 1364 bytes} [Mon Sep 5 12:35:39 2022] POST /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356/os-volume_attachments => generated 188 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 12:35:40.876198 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7ddf9eb1-a9c1-4a55-8276-b2ccf7a8e3a7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:40.876774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-7ddf9eb1-a9c1-4a55-8276-b2ccf7a8e3a7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:40.884000 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7ddf9eb1-a9c1-4a55-8276-b2ccf7a8e3a7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:40.884479 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7ddf9eb1-a9c1-4a55-8276-b2ccf7a8e3a7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:40.884905 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7ddf9eb1-a9c1-4a55-8276-b2ccf7a8e3a7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:40.885632 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7ddf9eb1-a9c1-4a55-8276-b2ccf7a8e3a7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:40.886082 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7ddf9eb1-a9c1-4a55-8276-b2ccf7a8e3a7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:40.886511 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7ddf9eb1-a9c1-4a55-8276-b2ccf7a8e3a7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:41.297816 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-be6a87b0-d21a-4cc5-9b2c-4414ee03aece tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:41.298564 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-be6a87b0-d21a-4cc5-9b2c-4414ee03aece tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:41.306390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-be6a87b0-d21a-4cc5-9b2c-4414ee03aece tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:41.306918 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-be6a87b0-d21a-4cc5-9b2c-4414ee03aece tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:41.307348 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-be6a87b0-d21a-4cc5-9b2c-4414ee03aece tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:41.308140 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-be6a87b0-d21a-4cc5-9b2c-4414ee03aece tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:41.308651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-be6a87b0-d21a-4cc5-9b2c-4414ee03aece tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:41.314244 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-be6a87b0-d21a-4cc5-9b2c-4414ee03aece tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:41.468850 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-be6a87b0-d21a-4cc5-9b2c-4414ee03aece tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:41.477895 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-be6a87b0-d21a-4cc5-9b2c-4414ee03aece tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1755 microversion: 2.1 time: 0.183957 Sep 05 12:35:41.478468 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 445/868] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:41 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:35:41.546324 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-7ddf9eb1-a9c1-4a55-8276-b2ccf7a8e3a7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "DELETE /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356/os-volume_attachments/1e8e901b-e5d1-4854-bc91-7b5c80136e66" status: 202 len: 0 microversion: 2.20 time: 0.674056 Sep 05 12:35:41.546923 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 424/869] 10.222.0.62 () {60 vars in 1457 bytes} [Mon Sep 5 12:35:40 2022] DELETE /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356/os-volume_attachments/1e8e901b-e5d1-4854-bc91-7b5c80136e66 => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 05 12:35:41.608977 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0f9ed762-17b6-4595-a316-ea1c4c4c6644 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:35:41.609564 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0f9ed762-17b6-4595-a316-ea1c4c4c6644 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:41.615796 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0f9ed762-17b6-4595-a316-ea1c4c4c6644 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:41.616280 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0f9ed762-17b6-4595-a316-ea1c4c4c6644 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:41.616711 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0f9ed762-17b6-4595-a316-ea1c4c4c6644 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:41.617402 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0f9ed762-17b6-4595-a316-ea1c4c4c6644 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:41.617853 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0f9ed762-17b6-4595-a316-ea1c4c4c6644 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:41.618273 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0f9ed762-17b6-4595-a316-ea1c4c4c6644 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:41.662907 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0f9ed762-17b6-4595-a316-ea1c4c4c6644 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121211) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 05 12:35:42.001453 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0f9ed762-17b6-4595-a316-ea1c4c4c6644 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "POST /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356/action" status: 202 len: 0 microversion: 2.20 time: 0.396336 Sep 05 12:35:42.002112 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 446/870] 10.222.0.62 () {62 vars in 1319 bytes} [Mon Sep 5 12:35:41 2022] POST /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:35:42.011299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e773be40-5948-45f8-b9e0-ba8180ffa09d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:42.011976 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-e773be40-5948-45f8-b9e0-ba8180ffa09d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:42.018683 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e773be40-5948-45f8-b9e0-ba8180ffa09d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:42.019206 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e773be40-5948-45f8-b9e0-ba8180ffa09d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:42.019676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e773be40-5948-45f8-b9e0-ba8180ffa09d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:42.020414 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e773be40-5948-45f8-b9e0-ba8180ffa09d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:42.020858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e773be40-5948-45f8-b9e0-ba8180ffa09d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:42.021274 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-e773be40-5948-45f8-b9e0-ba8180ffa09d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:42.173153 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-e773be40-5948-45f8-b9e0-ba8180ffa09d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:42.182057 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-e773be40-5948-45f8-b9e0-ba8180ffa09d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:42.183694 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-e773be40-5948-45f8-b9e0-ba8180ffa09d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:42.184940 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-e773be40-5948-45f8-b9e0-ba8180ffa09d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1673 microversion: 2.20 time: 0.178338 Sep 05 12:35:42.185573 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 425/871] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:42 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 12:35:42.503522 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-625d09ac-4765-4cc2-b753-3fc196163ded tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:42.504183 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-625d09ac-4765-4cc2-b753-3fc196163ded tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:42.512225 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-625d09ac-4765-4cc2-b753-3fc196163ded tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:42.512925 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-625d09ac-4765-4cc2-b753-3fc196163ded tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:42.513525 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-625d09ac-4765-4cc2-b753-3fc196163ded tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:42.514234 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-625d09ac-4765-4cc2-b753-3fc196163ded tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:42.514690 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-625d09ac-4765-4cc2-b753-3fc196163ded tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:42.515120 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-625d09ac-4765-4cc2-b753-3fc196163ded tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:42.740028 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-625d09ac-4765-4cc2-b753-3fc196163ded tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:42.748623 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-625d09ac-4765-4cc2-b753-3fc196163ded tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1755 microversion: 2.1 time: 0.250881 Sep 05 12:35:42.749215 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 447/872] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:42 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1755 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:43.212194 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ddee3eae-3998-451d-ac3b-74305ed3e1a8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:43.212832 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-ddee3eae-3998-451d-ac3b-74305ed3e1a8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:43.220000 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ddee3eae-3998-451d-ac3b-74305ed3e1a8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:43.227478 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ddee3eae-3998-451d-ac3b-74305ed3e1a8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:43.227478 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ddee3eae-3998-451d-ac3b-74305ed3e1a8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:43.227478 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ddee3eae-3998-451d-ac3b-74305ed3e1a8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:43.227478 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ddee3eae-3998-451d-ac3b-74305ed3e1a8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:43.228347 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ddee3eae-3998-451d-ac3b-74305ed3e1a8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:43.376469 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-ddee3eae-3998-451d-ac3b-74305ed3e1a8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:43.385592 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-ddee3eae-3998-451d-ac3b-74305ed3e1a8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:43.387077 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-ddee3eae-3998-451d-ac3b-74305ed3e1a8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:43.388293 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-ddee3eae-3998-451d-ac3b-74305ed3e1a8 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1673 microversion: 2.20 time: 0.181182 Sep 05 12:35:43.388867 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 426/873] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:43 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:43.772079 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1afd1bde-0817-4682-9701-21f4bf09e636 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:43.772707 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1afd1bde-0817-4682-9701-21f4bf09e636 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:43.779260 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1afd1bde-0817-4682-9701-21f4bf09e636 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:43.779795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1afd1bde-0817-4682-9701-21f4bf09e636 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:43.780235 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1afd1bde-0817-4682-9701-21f4bf09e636 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:43.780944 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1afd1bde-0817-4682-9701-21f4bf09e636 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:43.781406 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1afd1bde-0817-4682-9701-21f4bf09e636 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:43.781833 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1afd1bde-0817-4682-9701-21f4bf09e636 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:43.927908 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1afd1bde-0817-4682-9701-21f4bf09e636 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:43.936415 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1afd1bde-0817-4682-9701-21f4bf09e636 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1755 microversion: 2.1 time: 0.168306 Sep 05 12:35:43.936988 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 448/874] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:43 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:44.415055 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4f995008-bce5-4a84-991d-638f69443de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:44.415921 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-4f995008-bce5-4a84-991d-638f69443de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:44.419733 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=60 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:44.423664 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4f995008-bce5-4a84-991d-638f69443de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:44.424162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4f995008-bce5-4a84-991d-638f69443de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:44.425222 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4f995008-bce5-4a84-991d-638f69443de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:44.425991 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4f995008-bce5-4a84-991d-638f69443de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:44.426462 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4f995008-bce5-4a84-991d-638f69443de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:44.426872 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4f995008-bce5-4a84-991d-638f69443de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:44.563322 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-4f995008-bce5-4a84-991d-638f69443de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:44.571569 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-4f995008-bce5-4a84-991d-638f69443de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:44.573021 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-4f995008-bce5-4a84-991d-638f69443de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:44.574311 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-4f995008-bce5-4a84-991d-638f69443de2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1731 microversion: 2.20 time: 0.163299 Sep 05 12:35:44.574761 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 427/875] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:44 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:44.960604 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-87b3d9ba-3768-4863-86a2-5aeb811ebe94 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:44.961833 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-87b3d9ba-3768-4863-86a2-5aeb811ebe94 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:44.969107 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-87b3d9ba-3768-4863-86a2-5aeb811ebe94 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:44.969887 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-87b3d9ba-3768-4863-86a2-5aeb811ebe94 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:44.970483 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-87b3d9ba-3768-4863-86a2-5aeb811ebe94 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:44.971357 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-87b3d9ba-3768-4863-86a2-5aeb811ebe94 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:44.972080 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-87b3d9ba-3768-4863-86a2-5aeb811ebe94 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:44.972668 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-87b3d9ba-3768-4863-86a2-5aeb811ebe94 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:45.259102 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-87b3d9ba-3768-4863-86a2-5aeb811ebe94 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:45.261608 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:45.268588 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-87b3d9ba-3768-4863-86a2-5aeb811ebe94 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1758 microversion: 2.1 time: 0.312769 Sep 05 12:35:45.269411 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 449/876] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:35:44 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1758 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:35:45.602946 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-69187e2c-1adf-48fe-af20-4ac275914ce3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:45.603798 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-69187e2c-1adf-48fe-af20-4ac275914ce3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:45.610572 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-69187e2c-1adf-48fe-af20-4ac275914ce3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:45.611064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-69187e2c-1adf-48fe-af20-4ac275914ce3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:45.611492 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-69187e2c-1adf-48fe-af20-4ac275914ce3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:45.612270 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-69187e2c-1adf-48fe-af20-4ac275914ce3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:45.613259 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-69187e2c-1adf-48fe-af20-4ac275914ce3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:45.613690 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-69187e2c-1adf-48fe-af20-4ac275914ce3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:45.752941 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-69187e2c-1adf-48fe-af20-4ac275914ce3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:45.761159 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-69187e2c-1adf-48fe-af20-4ac275914ce3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:45.762604 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-69187e2c-1adf-48fe-af20-4ac275914ce3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:45.763804 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-69187e2c-1adf-48fe-af20-4ac275914ce3 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1731 microversion: 2.20 time: 0.165390 Sep 05 12:35:45.764359 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 428/877] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:45 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:46.793728 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0aa3571c-23bf-4b5a-81dd-b52647e7c1e1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:46.795278 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0aa3571c-23bf-4b5a-81dd-b52647e7c1e1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:46.807340 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0aa3571c-23bf-4b5a-81dd-b52647e7c1e1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:46.807850 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0aa3571c-23bf-4b5a-81dd-b52647e7c1e1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:46.808278 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0aa3571c-23bf-4b5a-81dd-b52647e7c1e1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:46.808982 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0aa3571c-23bf-4b5a-81dd-b52647e7c1e1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:46.812425 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0aa3571c-23bf-4b5a-81dd-b52647e7c1e1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:46.813691 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0aa3571c-23bf-4b5a-81dd-b52647e7c1e1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:46.976164 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0aa3571c-23bf-4b5a-81dd-b52647e7c1e1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:46.984598 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0aa3571c-23bf-4b5a-81dd-b52647e7c1e1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:46.986035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0aa3571c-23bf-4b5a-81dd-b52647e7c1e1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:46.987825 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0aa3571c-23bf-4b5a-81dd-b52647e7c1e1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1731 microversion: 2.20 time: 0.201027 Sep 05 12:35:46.988841 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 450/878] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:46 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1731 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:48.014869 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1d1c0f8c-3a2d-472c-8fcd-7134a90fb8b7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:48.015456 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1d1c0f8c-3a2d-472c-8fcd-7134a90fb8b7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:48.022678 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1d1c0f8c-3a2d-472c-8fcd-7134a90fb8b7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:48.023162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1d1c0f8c-3a2d-472c-8fcd-7134a90fb8b7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:48.023627 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1d1c0f8c-3a2d-472c-8fcd-7134a90fb8b7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:48.024331 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1d1c0f8c-3a2d-472c-8fcd-7134a90fb8b7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:48.024962 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1d1c0f8c-3a2d-472c-8fcd-7134a90fb8b7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:48.025389 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1d1c0f8c-3a2d-472c-8fcd-7134a90fb8b7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:48.171621 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1d1c0f8c-3a2d-472c-8fcd-7134a90fb8b7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:48.182706 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1d1c0f8c-3a2d-472c-8fcd-7134a90fb8b7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:48.184424 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1d1c0f8c-3a2d-472c-8fcd-7134a90fb8b7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:48.185773 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1d1c0f8c-3a2d-472c-8fcd-7134a90fb8b7 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1731 microversion: 2.20 time: 0.175382 Sep 05 12:35:48.197017 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 429/879] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:48 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:49.213481 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-6275eeb2-f107-49b8-af13-fd9627e9f5a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:49.214290 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-6275eeb2-f107-49b8-af13-fd9627e9f5a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:49.221378 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6275eeb2-f107-49b8-af13-fd9627e9f5a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:49.222399 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6275eeb2-f107-49b8-af13-fd9627e9f5a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:49.222851 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6275eeb2-f107-49b8-af13-fd9627e9f5a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:49.223578 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6275eeb2-f107-49b8-af13-fd9627e9f5a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:49.224036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6275eeb2-f107-49b8-af13-fd9627e9f5a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:49.224489 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6275eeb2-f107-49b8-af13-fd9627e9f5a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:49.382882 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6275eeb2-f107-49b8-af13-fd9627e9f5a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:49.391561 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6275eeb2-f107-49b8-af13-fd9627e9f5a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:49.393105 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6275eeb2-f107-49b8-af13-fd9627e9f5a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:49.394825 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-6275eeb2-f107-49b8-af13-fd9627e9f5a1 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1731 microversion: 2.20 time: 0.185345 Sep 05 12:35:49.395683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 451/880] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:49 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:50.420412 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7fc97e79-af81-40f9-b37e-480d04ce7706 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:50.421296 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-7fc97e79-af81-40f9-b37e-480d04ce7706 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:50.428211 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7fc97e79-af81-40f9-b37e-480d04ce7706 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:50.428718 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7fc97e79-af81-40f9-b37e-480d04ce7706 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:50.429144 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7fc97e79-af81-40f9-b37e-480d04ce7706 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:50.429864 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7fc97e79-af81-40f9-b37e-480d04ce7706 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:50.430493 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7fc97e79-af81-40f9-b37e-480d04ce7706 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:50.431380 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7fc97e79-af81-40f9-b37e-480d04ce7706 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:50.592659 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-7fc97e79-af81-40f9-b37e-480d04ce7706 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:50.596398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:50.601957 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-7fc97e79-af81-40f9-b37e-480d04ce7706 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:50.603437 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-7fc97e79-af81-40f9-b37e-480d04ce7706 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:50.607088 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-7fc97e79-af81-40f9-b37e-480d04ce7706 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1731 microversion: 2.20 time: 0.188470 Sep 05 12:35:50.607088 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 430/881] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:50 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:51.633231 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3fb8095d-2c1b-463d-a998-37184d7e1dfa tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:51.633866 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-3fb8095d-2c1b-463d-a998-37184d7e1dfa tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:51.641007 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3fb8095d-2c1b-463d-a998-37184d7e1dfa tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:51.641590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3fb8095d-2c1b-463d-a998-37184d7e1dfa tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:51.642087 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3fb8095d-2c1b-463d-a998-37184d7e1dfa tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:51.643028 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3fb8095d-2c1b-463d-a998-37184d7e1dfa tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:51.645485 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3fb8095d-2c1b-463d-a998-37184d7e1dfa tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:51.645485 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3fb8095d-2c1b-463d-a998-37184d7e1dfa tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:51.802002 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3fb8095d-2c1b-463d-a998-37184d7e1dfa tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:51.810919 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3fb8095d-2c1b-463d-a998-37184d7e1dfa tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:51.812525 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3fb8095d-2c1b-463d-a998-37184d7e1dfa tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:51.813779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3fb8095d-2c1b-463d-a998-37184d7e1dfa tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1731 microversion: 2.20 time: 0.184897 Sep 05 12:35:51.814595 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 452/882] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:51 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:52.840441 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-0305ddb9-a5dd-4fb7-845d-07b0e10e9e11 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:52.841829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-0305ddb9-a5dd-4fb7-845d-07b0e10e9e11 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:52.852976 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0305ddb9-a5dd-4fb7-845d-07b0e10e9e11 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:52.853655 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0305ddb9-a5dd-4fb7-845d-07b0e10e9e11 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:52.854110 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0305ddb9-a5dd-4fb7-845d-07b0e10e9e11 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:52.854996 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0305ddb9-a5dd-4fb7-845d-07b0e10e9e11 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:52.855490 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0305ddb9-a5dd-4fb7-845d-07b0e10e9e11 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:52.855983 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0305ddb9-a5dd-4fb7-845d-07b0e10e9e11 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:53.017225 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-0305ddb9-a5dd-4fb7-845d-07b0e10e9e11 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:53.031749 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-0305ddb9-a5dd-4fb7-845d-07b0e10e9e11 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:53.033202 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-0305ddb9-a5dd-4fb7-845d-07b0e10e9e11 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:53.034977 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-0305ddb9-a5dd-4fb7-845d-07b0e10e9e11 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1731 microversion: 2.20 time: 0.198539 Sep 05 12:35:53.035852 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 431/883] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:52 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:54.064632 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-337ed3cc-38bc-4c6a-9b9a-472f5b85e9b9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:54.065417 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-337ed3cc-38bc-4c6a-9b9a-472f5b85e9b9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:54.073951 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-337ed3cc-38bc-4c6a-9b9a-472f5b85e9b9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:54.074427 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-337ed3cc-38bc-4c6a-9b9a-472f5b85e9b9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:54.074865 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-337ed3cc-38bc-4c6a-9b9a-472f5b85e9b9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:54.075739 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-337ed3cc-38bc-4c6a-9b9a-472f5b85e9b9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:54.076246 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-337ed3cc-38bc-4c6a-9b9a-472f5b85e9b9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:54.076698 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-337ed3cc-38bc-4c6a-9b9a-472f5b85e9b9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:54.216226 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-337ed3cc-38bc-4c6a-9b9a-472f5b85e9b9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:54.225221 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-337ed3cc-38bc-4c6a-9b9a-472f5b85e9b9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:54.226682 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-337ed3cc-38bc-4c6a-9b9a-472f5b85e9b9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:54.227927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-337ed3cc-38bc-4c6a-9b9a-472f5b85e9b9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1731 microversion: 2.20 time: 0.167673 Sep 05 12:35:54.228684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 453/884] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:54 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:55.254354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-191a277a-f41e-4d22-807a-3c2a52427698 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:55.255894 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-191a277a-f41e-4d22-807a-3c2a52427698 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:55.263034 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-191a277a-f41e-4d22-807a-3c2a52427698 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:55.263517 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-191a277a-f41e-4d22-807a-3c2a52427698 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:55.263979 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-191a277a-f41e-4d22-807a-3c2a52427698 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:55.264676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-191a277a-f41e-4d22-807a-3c2a52427698 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:55.265136 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-191a277a-f41e-4d22-807a-3c2a52427698 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:55.265557 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-191a277a-f41e-4d22-807a-3c2a52427698 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:55.400684 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-191a277a-f41e-4d22-807a-3c2a52427698 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:55.408683 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-191a277a-f41e-4d22-807a-3c2a52427698 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:55.410135 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-191a277a-f41e-4d22-807a-3c2a52427698 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:55.411278 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-191a277a-f41e-4d22-807a-3c2a52427698 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1731 microversion: 2.20 time: 0.160894 Sep 05 12:35:55.411860 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 432/885] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:55 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:56.436905 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-419213f0-cf13-4a45-b8fa-6a3705f4ebef tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:56.437520 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-419213f0-cf13-4a45-b8fa-6a3705f4ebef tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:56.444633 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-419213f0-cf13-4a45-b8fa-6a3705f4ebef tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:56.445143 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-419213f0-cf13-4a45-b8fa-6a3705f4ebef tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:56.445574 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-419213f0-cf13-4a45-b8fa-6a3705f4ebef tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:56.446273 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-419213f0-cf13-4a45-b8fa-6a3705f4ebef tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:56.446722 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-419213f0-cf13-4a45-b8fa-6a3705f4ebef tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:56.447145 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-419213f0-cf13-4a45-b8fa-6a3705f4ebef tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:56.577410 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-419213f0-cf13-4a45-b8fa-6a3705f4ebef tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:56.586145 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-419213f0-cf13-4a45-b8fa-6a3705f4ebef tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:56.587608 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-419213f0-cf13-4a45-b8fa-6a3705f4ebef tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:56.588769 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-419213f0-cf13-4a45-b8fa-6a3705f4ebef tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1731 microversion: 2.20 time: 0.155784 Sep 05 12:35:56.589359 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 454/886] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:56 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:57.613668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-33b676fa-7f96-4985-bfe0-3138ffcb9ff2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:57.614293 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-33b676fa-7f96-4985-bfe0-3138ffcb9ff2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:57.621167 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-33b676fa-7f96-4985-bfe0-3138ffcb9ff2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:57.621654 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-33b676fa-7f96-4985-bfe0-3138ffcb9ff2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:57.622089 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-33b676fa-7f96-4985-bfe0-3138ffcb9ff2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:57.622796 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-33b676fa-7f96-4985-bfe0-3138ffcb9ff2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:57.623248 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-33b676fa-7f96-4985-bfe0-3138ffcb9ff2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:57.623695 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-33b676fa-7f96-4985-bfe0-3138ffcb9ff2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:57.762801 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-33b676fa-7f96-4985-bfe0-3138ffcb9ff2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:57.772129 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-33b676fa-7f96-4985-bfe0-3138ffcb9ff2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:57.773612 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-33b676fa-7f96-4985-bfe0-3138ffcb9ff2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:57.774813 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-33b676fa-7f96-4985-bfe0-3138ffcb9ff2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1731 microversion: 2.20 time: 0.165306 Sep 05 12:35:57.775378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 433/887] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:57 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:58.804232 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-6e334e5d-2ba1-495f-b8d5-e003b6744335 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:35:58.805722 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-6e334e5d-2ba1-495f-b8d5-e003b6744335 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:35:58.814118 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6e334e5d-2ba1-495f-b8d5-e003b6744335 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:58.824807 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6e334e5d-2ba1-495f-b8d5-e003b6744335 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:58.824807 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6e334e5d-2ba1-495f-b8d5-e003b6744335 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:58.824807 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6e334e5d-2ba1-495f-b8d5-e003b6744335 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:58.824807 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6e334e5d-2ba1-495f-b8d5-e003b6744335 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:58.825206 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6e334e5d-2ba1-495f-b8d5-e003b6744335 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:58.968406 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6e334e5d-2ba1-495f-b8d5-e003b6744335 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:58.977193 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6e334e5d-2ba1-495f-b8d5-e003b6744335 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:58.978628 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6e334e5d-2ba1-495f-b8d5-e003b6744335 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:35:58.979822 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-6e334e5d-2ba1-495f-b8d5-e003b6744335 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1731 microversion: 2.20 time: 0.181975 Sep 05 12:35:58.980387 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 455/888] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:35:58 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:35:59.619923 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-681a4f18-2c00-499d-b36e-d5cb47412858 req-4cdbe917-657a-457c-a8d7-41c1e36b1281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "407e87bb-faeb-4ba6-b6dc-e9b7a3690356", "name": "network-vif-plugged", "status": "completed", "tag": "3c7003e7-309e-4432-9c69-6cc1517fcb8d"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:35:59.630668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-681a4f18-2c00-499d-b36e-d5cb47412858 req-4cdbe917-657a-457c-a8d7-41c1e36b1281 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:35:59.638879 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-681a4f18-2c00-499d-b36e-d5cb47412858 req-4cdbe917-657a-457c-a8d7-41c1e36b1281 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:35:59.638879 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-681a4f18-2c00-499d-b36e-d5cb47412858 req-4cdbe917-657a-457c-a8d7-41c1e36b1281 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:35:59.643218 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-681a4f18-2c00-499d-b36e-d5cb47412858 req-4cdbe917-657a-457c-a8d7-41c1e36b1281 service nova] Creating event network-vif-plugged:3c7003e7-309e-4432-9c69-6cc1517fcb8d for instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 on hv-cinder-80135 Sep 05 12:35:59.649105 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-681a4f18-2c00-499d-b36e-d5cb47412858 req-4cdbe917-657a-457c-a8d7-41c1e36b1281 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033207 Sep 05 12:35:59.649936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 434/889] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:36:00.008556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3c4ba6d3-fefe-466b-bfe6-2a3fa8ed9679 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:00.009875 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-3c4ba6d3-fefe-466b-bfe6-2a3fa8ed9679 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:00.016970 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3c4ba6d3-fefe-466b-bfe6-2a3fa8ed9679 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:00.017162 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3c4ba6d3-fefe-466b-bfe6-2a3fa8ed9679 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:00.017607 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3c4ba6d3-fefe-466b-bfe6-2a3fa8ed9679 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:00.018322 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3c4ba6d3-fefe-466b-bfe6-2a3fa8ed9679 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:00.018775 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3c4ba6d3-fefe-466b-bfe6-2a3fa8ed9679 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:00.019225 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3c4ba6d3-fefe-466b-bfe6-2a3fa8ed9679 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:00.314497 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3c4ba6d3-fefe-466b-bfe6-2a3fa8ed9679 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:00.322211 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3c4ba6d3-fefe-466b-bfe6-2a3fa8ed9679 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:00.323725 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3c4ba6d3-fefe-466b-bfe6-2a3fa8ed9679 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:00.324889 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3c4ba6d3-fefe-466b-bfe6-2a3fa8ed9679 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1731 microversion: 2.20 time: 0.321106 Sep 05 12:36:00.325432 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 456/890] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:36:00 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1731 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:36:01.350917 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-aae3acac-34da-4818-8412-d088f1fab3d2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:01.351678 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-aae3acac-34da-4818-8412-d088f1fab3d2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:01.358858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aae3acac-34da-4818-8412-d088f1fab3d2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:01.359339 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aae3acac-34da-4818-8412-d088f1fab3d2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:01.359795 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aae3acac-34da-4818-8412-d088f1fab3d2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:01.360488 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aae3acac-34da-4818-8412-d088f1fab3d2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:01.360941 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aae3acac-34da-4818-8412-d088f1fab3d2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:01.361368 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aae3acac-34da-4818-8412-d088f1fab3d2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:01.500721 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-aae3acac-34da-4818-8412-d088f1fab3d2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:01.509034 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-aae3acac-34da-4818-8412-d088f1fab3d2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:01.510485 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-aae3acac-34da-4818-8412-d088f1fab3d2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:01.511670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-aae3acac-34da-4818-8412-d088f1fab3d2 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1731 microversion: 2.20 time: 0.165028 Sep 05 12:36:01.512220 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 435/891] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:36:01 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:36:02.537640 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-cfee7556-9856-462a-b18d-28163dd5fcf9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:02.538252 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-cfee7556-9856-462a-b18d-28163dd5fcf9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:02.545443 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cfee7556-9856-462a-b18d-28163dd5fcf9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:02.545926 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cfee7556-9856-462a-b18d-28163dd5fcf9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:02.547607 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cfee7556-9856-462a-b18d-28163dd5fcf9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:02.547607 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cfee7556-9856-462a-b18d-28163dd5fcf9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:02.547607 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cfee7556-9856-462a-b18d-28163dd5fcf9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:02.548029 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cfee7556-9856-462a-b18d-28163dd5fcf9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:02.699727 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-cfee7556-9856-462a-b18d-28163dd5fcf9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:02.708233 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-cfee7556-9856-462a-b18d-28163dd5fcf9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:02.709682 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-cfee7556-9856-462a-b18d-28163dd5fcf9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:02.710848 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-cfee7556-9856-462a-b18d-28163dd5fcf9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1731 microversion: 2.20 time: 0.177362 Sep 05 12:36:02.711436 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 457/892] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:36:02 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:36:02.829798 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-cf507c24-f971-422d-80ee-ac0940aef35e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:02.830346 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-cf507c24-f971-422d-80ee-ac0940aef35e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:02.837540 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cf507c24-f971-422d-80ee-ac0940aef35e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:02.838020 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cf507c24-f971-422d-80ee-ac0940aef35e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:02.838448 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cf507c24-f971-422d-80ee-ac0940aef35e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:02.839136 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cf507c24-f971-422d-80ee-ac0940aef35e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:02.839634 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cf507c24-f971-422d-80ee-ac0940aef35e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:02.840036 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cf507c24-f971-422d-80ee-ac0940aef35e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:02.868280 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-cf507c24-f971-422d-80ee-ac0940aef35e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5/ips" status: 200 len: 150 microversion: 2.1 time: 0.042864 Sep 05 12:36:02.873666 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 436/893] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Sep 5 12:36:02 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:36:03.738429 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e9b5a33d-8f04-4705-8d8e-4f58666c0f0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:03.739026 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e9b5a33d-8f04-4705-8d8e-4f58666c0f0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:03.746874 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e9b5a33d-8f04-4705-8d8e-4f58666c0f0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:03.747353 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e9b5a33d-8f04-4705-8d8e-4f58666c0f0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:03.747913 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e9b5a33d-8f04-4705-8d8e-4f58666c0f0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:03.748644 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e9b5a33d-8f04-4705-8d8e-4f58666c0f0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:03.749259 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e9b5a33d-8f04-4705-8d8e-4f58666c0f0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:03.749688 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e9b5a33d-8f04-4705-8d8e-4f58666c0f0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:03.893208 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e9b5a33d-8f04-4705-8d8e-4f58666c0f0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:03.901912 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e9b5a33d-8f04-4705-8d8e-4f58666c0f0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:03.903360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e9b5a33d-8f04-4705-8d8e-4f58666c0f0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:03.904573 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e9b5a33d-8f04-4705-8d8e-4f58666c0f0d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1718 microversion: 2.20 time: 0.170437 Sep 05 12:36:03.905119 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 458/894] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:36:03 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1718 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:36:04.527978 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4fab51d8-9f66-48fa-af26-1e082953265f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3dda92b9-2269-4af1-80d3-7bb8a9d7f191"}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:36:04.530436 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-4fab51d8-9f66-48fa-af26-1e082953265f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:04.536714 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4fab51d8-9f66-48fa-af26-1e082953265f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:04.537200 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4fab51d8-9f66-48fa-af26-1e082953265f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:04.537628 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4fab51d8-9f66-48fa-af26-1e082953265f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:04.538318 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4fab51d8-9f66-48fa-af26-1e082953265f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:04.538768 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4fab51d8-9f66-48fa-af26-1e082953265f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:04.539184 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4fab51d8-9f66-48fa-af26-1e082953265f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:05.391477 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-4fab51d8-9f66-48fa-af26-1e082953265f tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "POST /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.868088 Sep 05 12:36:05.392133 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 437/895] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Sep 5 12:36:04 2022] POST /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5/os-volume_attachments => generated 194 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:36:14.254312 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-5f1bca1a-b64a-4e4d-9067-6a1db7f410b7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:14.254889 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-5f1bca1a-b64a-4e4d-9067-6a1db7f410b7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:14.257137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:36:14.257810 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=55 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:36:14.263815 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5f1bca1a-b64a-4e4d-9067-6a1db7f410b7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:14.264302 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5f1bca1a-b64a-4e4d-9067-6a1db7f410b7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:14.264736 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5f1bca1a-b64a-4e4d-9067-6a1db7f410b7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:14.265477 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5f1bca1a-b64a-4e4d-9067-6a1db7f410b7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:14.265937 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5f1bca1a-b64a-4e4d-9067-6a1db7f410b7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:14.266360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5f1bca1a-b64a-4e4d-9067-6a1db7f410b7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:14.353952 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.objects.instance [None req-5f1bca1a-b64a-4e4d-9067-6a1db7f410b7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lazy-loading 'services' on Instance uuid 8d037f32-c2bd-4f5e-b99c-de3857df58a5 {{(pid=121211) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:36:14.536716 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-5f1bca1a-b64a-4e4d-9067-6a1db7f410b7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5/os-volume_attachments/3dda92b9-2269-4af1-80d3-7bb8a9d7f191" status: 202 len: 0 microversion: 2.1 time: 0.286294 Sep 05 12:36:14.537301 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 459/896] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Sep 5 12:36:14 2022] DELETE /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5/os-volume_attachments/3dda92b9-2269-4af1-80d3-7bb8a9d7f191 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:36:14.544638 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=21 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:36:14.549172 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-014f197c-878c-4dc7-92b1-163ecd16f05b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:14.552022 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-014f197c-878c-4dc7-92b1-163ecd16f05b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:14.558888 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-014f197c-878c-4dc7-92b1-163ecd16f05b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:14.559964 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-014f197c-878c-4dc7-92b1-163ecd16f05b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:14.560408 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-014f197c-878c-4dc7-92b1-163ecd16f05b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:14.561099 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-014f197c-878c-4dc7-92b1-163ecd16f05b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:14.561547 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-014f197c-878c-4dc7-92b1-163ecd16f05b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:14.562003 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-014f197c-878c-4dc7-92b1-163ecd16f05b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:14.594345 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-014f197c-878c-4dc7-92b1-163ecd16f05b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052117 Sep 05 12:36:14.594919 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 438/897] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:36:14 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:36:15.612205 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7935c276-a273-4eef-8f54-1418a3ae7cb2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:15.614549 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-7935c276-a273-4eef-8f54-1418a3ae7cb2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:15.621136 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7935c276-a273-4eef-8f54-1418a3ae7cb2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:15.621616 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7935c276-a273-4eef-8f54-1418a3ae7cb2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:15.622050 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7935c276-a273-4eef-8f54-1418a3ae7cb2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:15.623238 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7935c276-a273-4eef-8f54-1418a3ae7cb2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:15.623712 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7935c276-a273-4eef-8f54-1418a3ae7cb2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:15.624134 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7935c276-a273-4eef-8f54-1418a3ae7cb2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:15.655872 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-7935c276-a273-4eef-8f54-1418a3ae7cb2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049035 Sep 05 12:36:15.656445 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 460/898] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:36:15 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:36:16.668968 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a5ef48a9-272d-4d03-809d-4bb819e33dae tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:16.671220 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a5ef48a9-272d-4d03-809d-4bb819e33dae tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:16.677973 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a5ef48a9-272d-4d03-809d-4bb819e33dae tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:16.678454 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a5ef48a9-272d-4d03-809d-4bb819e33dae tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:16.678885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a5ef48a9-272d-4d03-809d-4bb819e33dae tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:16.679610 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a5ef48a9-272d-4d03-809d-4bb819e33dae tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:16.680064 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a5ef48a9-272d-4d03-809d-4bb819e33dae tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:16.680482 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a5ef48a9-272d-4d03-809d-4bb819e33dae tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:16.710722 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a5ef48a9-272d-4d03-809d-4bb819e33dae tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046002 Sep 05 12:36:16.711299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 439/899] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:36:16 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 12:36:16.775439 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a4800e38-3ba9-40ce-bf68-615f0e762e3e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:16.776087 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a4800e38-3ba9-40ce-bf68-615f0e762e3e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:16.783044 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a4800e38-3ba9-40ce-bf68-615f0e762e3e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:16.783524 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a4800e38-3ba9-40ce-bf68-615f0e762e3e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:16.783989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a4800e38-3ba9-40ce-bf68-615f0e762e3e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:16.784678 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a4800e38-3ba9-40ce-bf68-615f0e762e3e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:16.785127 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a4800e38-3ba9-40ce-bf68-615f0e762e3e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:16.785545 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a4800e38-3ba9-40ce-bf68-615f0e762e3e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:16.812409 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a4800e38-3ba9-40ce-bf68-615f0e762e3e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Going to try to terminate instance {{(pid=121211) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:36:17.200449 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a4800e38-3ba9-40ce-bf68-615f0e762e3e tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5" status: 204 len: 0 microversion: 2.1 time: 0.428634 Sep 05 12:36:17.201626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 461/900] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:36:16 2022] DELETE /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:36:17.209982 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a9ea37ec-bab6-469e-8752-8e5e7a6d83e6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:17.210611 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a9ea37ec-bab6-469e-8752-8e5e7a6d83e6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:17.216720 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a9ea37ec-bab6-469e-8752-8e5e7a6d83e6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:17.217215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a9ea37ec-bab6-469e-8752-8e5e7a6d83e6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:17.217649 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a9ea37ec-bab6-469e-8752-8e5e7a6d83e6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:17.218351 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a9ea37ec-bab6-469e-8752-8e5e7a6d83e6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:17.218898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a9ea37ec-bab6-469e-8752-8e5e7a6d83e6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:17.219383 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a9ea37ec-bab6-469e-8752-8e5e7a6d83e6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:17.351487 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a9ea37ec-bab6-469e-8752-8e5e7a6d83e6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:17.359877 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a9ea37ec-bab6-469e-8752-8e5e7a6d83e6 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5" status: 200 len: 1682 microversion: 2.1 time: 0.153635 Sep 05 12:36:17.360447 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 440/901] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:17 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:18.385340 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d86bc7e2-4376-4611-ae33-47320d6e8cce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:18.385950 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d86bc7e2-4376-4611-ae33-47320d6e8cce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:18.393042 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d86bc7e2-4376-4611-ae33-47320d6e8cce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:18.393528 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d86bc7e2-4376-4611-ae33-47320d6e8cce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:18.393966 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d86bc7e2-4376-4611-ae33-47320d6e8cce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:18.394669 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d86bc7e2-4376-4611-ae33-47320d6e8cce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:18.395130 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d86bc7e2-4376-4611-ae33-47320d6e8cce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:18.395580 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d86bc7e2-4376-4611-ae33-47320d6e8cce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:18.533332 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d86bc7e2-4376-4611-ae33-47320d6e8cce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:18.541227 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d86bc7e2-4376-4611-ae33-47320d6e8cce tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5" status: 200 len: 1682 microversion: 2.1 time: 0.160467 Sep 05 12:36:18.542075 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 462/902] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:18 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:19.567633 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7e4de6f9-c87b-4b49-85bb-cf0ed7a7d081 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:19.568256 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-7e4de6f9-c87b-4b49-85bb-cf0ed7a7d081 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:19.574926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7e4de6f9-c87b-4b49-85bb-cf0ed7a7d081 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:19.575419 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7e4de6f9-c87b-4b49-85bb-cf0ed7a7d081 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:19.575892 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7e4de6f9-c87b-4b49-85bb-cf0ed7a7d081 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:19.576608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7e4de6f9-c87b-4b49-85bb-cf0ed7a7d081 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:19.577066 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7e4de6f9-c87b-4b49-85bb-cf0ed7a7d081 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:19.577512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7e4de6f9-c87b-4b49-85bb-cf0ed7a7d081 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:19.723261 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-7e4de6f9-c87b-4b49-85bb-cf0ed7a7d081 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:19.736193 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-7e4de6f9-c87b-4b49-85bb-cf0ed7a7d081 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5" status: 200 len: 1682 microversion: 2.1 time: 0.171826 Sep 05 12:36:19.736599 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 441/903] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:19 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:20.208531 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-d02a8ab1-a5a4-4be2-8235-7ab890689d81 req-669fea50-c54b-4306-89f5-78ececdbfc16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d037f32-c2bd-4f5e-b99c-de3857df58a5", "name": "network-vif-deleted", "tag": "4cd18a9b-7ea9-4a20-8908-c317397696cf"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:36:20.218961 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-d02a8ab1-a5a4-4be2-8235-7ab890689d81 req-669fea50-c54b-4306-89f5-78ececdbfc16 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:20.219625 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-d02a8ab1-a5a4-4be2-8235-7ab890689d81 req-669fea50-c54b-4306-89f5-78ececdbfc16 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:20.220090 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-d02a8ab1-a5a4-4be2-8235-7ab890689d81 req-669fea50-c54b-4306-89f5-78ececdbfc16 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:20.231602 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-d02a8ab1-a5a4-4be2-8235-7ab890689d81 req-669fea50-c54b-4306-89f5-78ececdbfc16 service nova] Creating event network-vif-deleted:4cd18a9b-7ea9-4a20-8908-c317397696cf for instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 on hv-cinder-80135 Sep 05 12:36:20.237447 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-d02a8ab1-a5a4-4be2-8235-7ab890689d81 req-669fea50-c54b-4306-89f5-78ececdbfc16 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032613 Sep 05 12:36:20.238181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 463/904] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:36:20.760689 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4d7a1337-fa1e-4174-9a99-b10faa172fa7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:20.762028 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-4d7a1337-fa1e-4174-9a99-b10faa172fa7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:20.771265 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d7a1337-fa1e-4174-9a99-b10faa172fa7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:20.772312 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d7a1337-fa1e-4174-9a99-b10faa172fa7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:20.773337 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d7a1337-fa1e-4174-9a99-b10faa172fa7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:20.774537 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d7a1337-fa1e-4174-9a99-b10faa172fa7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:20.775275 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d7a1337-fa1e-4174-9a99-b10faa172fa7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:20.775975 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d7a1337-fa1e-4174-9a99-b10faa172fa7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:20.810818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d7a1337-fa1e-4174-9a99-b10faa172fa7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:20.811291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d7a1337-fa1e-4174-9a99-b10faa172fa7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:20.811762 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d7a1337-fa1e-4174-9a99-b10faa172fa7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:20.812212 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-4d7a1337-fa1e-4174-9a99-b10faa172fa7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lazy-loading 'fault' on Instance uuid 8d037f32-c2bd-4f5e-b99c-de3857df58a5 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:36:20.858906 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-4d7a1337-fa1e-4174-9a99-b10faa172fa7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2273220e824339bd13d968c75df26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6830d2e75a47c8a757d4a66c6695ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:20.868836 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-4d7a1337-fa1e-4174-9a99-b10faa172fa7 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5" status: 200 len: 1332 microversion: 2.1 time: 0.111951 Sep 05 12:36:20.869739 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 442/905] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:20 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:20.976181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-58254171-8c08-47ef-a2c7-3c351ccce4c3 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-320942451"}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:36:20.977551 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-58254171-8c08-47ef-a2c7-3c351ccce4c3 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:20.984857 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-58254171-8c08-47ef-a2c7-3c351ccce4c3 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:20.989645 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-58254171-8c08-47ef-a2c7-3c351ccce4c3 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:20.989645 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-58254171-8c08-47ef-a2c7-3c351ccce4c3 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:20.989645 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-58254171-8c08-47ef-a2c7-3c351ccce4c3 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:20.989645 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-58254171-8c08-47ef-a2c7-3c351ccce4c3 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:20.990039 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-58254171-8c08-47ef-a2c7-3c351ccce4c3 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:21.134312 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.network.security_group_api [None req-58254171-8c08-47ef-a2c7-3c351ccce4c3 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Removing security group 3533742a-a686-479f-81e8-521361f5def6 from port 484ab154-1eb7-4f51-b8a6-351d2c0646e4 Sep 05 12:36:21.592589 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-58254171-8c08-47ef-a2c7-3c351ccce4c3 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "POST /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f/action" status: 202 len: 0 microversion: 2.1 time: 0.620843 Sep 05 12:36:21.593205 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 464/906] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Sep 5 12:36:20 2022] POST /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f/action => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:36:21.895820 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-77181fc4-0f69-44bd-a927-0e4aea69b689 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:21.895820 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-77181fc4-0f69-44bd-a927-0e4aea69b689 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:21.910373 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-77181fc4-0f69-44bd-a927-0e4aea69b689 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:21.915223 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-77181fc4-0f69-44bd-a927-0e4aea69b689 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:21.915223 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-77181fc4-0f69-44bd-a927-0e4aea69b689 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:21.915223 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-77181fc4-0f69-44bd-a927-0e4aea69b689 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:21.915223 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-77181fc4-0f69-44bd-a927-0e4aea69b689 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:21.915618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-77181fc4-0f69-44bd-a927-0e4aea69b689 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-77181fc4-0f69-44bd-a927-0e4aea69b689 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] HTTP exception thrown: Instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 could not be found. Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-77181fc4-0f69-44bd-a927-0e4aea69b689 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Request method failure captured: Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 HTTP/1.1 Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFeufoItTQsL_7sLOi4KSEP2anJWuFcJFO0wxpElVaUiOIZRHfpaIO7Ki-7p9RdECrMyfb98W4yaBOl3v_K7XBLi4W-ns2FJ7XkuNLBlexiQUHW-JFKbXbPcVAg_pV0PiNN_PWY357J1AeDPeP96j3jwWObDa2p7wcvUcxOyeHOpzSuo Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:36:21.939514 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:36:21.941904 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:36:21.941904 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:21.941904 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:36:21.941904 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:21.941904 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:36:21.941904 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:36:21.941904 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:36:21.941904 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: de2273220e824339bd13d968c75df26b Sep 05 12:36:21.941904 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:36:21.941904 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:36:21.941904 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 could not be found. Sep 05 12:36:21.941904 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': '8d037f32-c2bd-4f5e-b99c-de3857df58a5'} Sep 05 12:36:21.942854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:36:21.942854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:21.942854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:36:21.942854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:36:21.942854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:36:21.942854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:36:21.942854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:36:21.942854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:36:21.942854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:36:21.942854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:36:21.942854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 could not be found. Sep 05 12:36:21.942854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:21.942854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:21.942854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:21.942854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:21.942854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:21.942854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:21.942854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:36:21.942854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:36:21.942854 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:36:21.944600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:36:21.944600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:36:21.944600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:36:21.944600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:36:21.944600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:36:21.944600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:36:21.944600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:36:21.944600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 could not be found. Sep 05 12:36:21.944600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:21.944600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:21.944600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:21.944600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:21.944600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:21.944600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:21.944600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:36:21.944600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:36:21.944600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 could not be found. Sep 05 12:36:21.944600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:21.946093 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-77181fc4-0f69-44bd-a927-0e4aea69b689 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Returning 404 to user: Instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:36:21.946093 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-77181fc4-0f69-44bd-a927-0e4aea69b689 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5" status: 404 len: 111 microversion: 2.1 time: 0.051012 Sep 05 12:36:21.946093 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 443/907] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:21 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:36:21.950032 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3237dc8c-08c5-4767-ad8c-f17a677da54b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '.version_select at 0x7fe712811f70>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:22.110509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3237dc8c-08c5-4767-ad8c-f17a677da54b tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104172297" status: 202 len: 0 microversion: 2.1 time: 0.164863 Sep 05 12:36:22.111260 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 465/908] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Sep 5 12:36:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104172297 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:36:22.253156 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-c541bd04-da43-418c-8a2a-02007aad23f6 req-a74c7b03-a75e-42fc-8fdc-fa66923909e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8aa06a-9ac0-41d2-93ba-ae42895d418f", "tag": "484ab154-1eb7-4f51-b8a6-351d2c0646e4"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:36:22.262748 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-c541bd04-da43-418c-8a2a-02007aad23f6 req-a74c7b03-a75e-42fc-8fdc-fa66923909e6 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:22.263829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-c541bd04-da43-418c-8a2a-02007aad23f6 req-a74c7b03-a75e-42fc-8fdc-fa66923909e6 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:22.264255 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-c541bd04-da43-418c-8a2a-02007aad23f6 req-a74c7b03-a75e-42fc-8fdc-fa66923909e6 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:22.276678 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-c541bd04-da43-418c-8a2a-02007aad23f6 req-a74c7b03-a75e-42fc-8fdc-fa66923909e6 service nova] Creating event network-changed:484ab154-1eb7-4f51-b8a6-351d2c0646e4 for instance 7a8aa06a-9ac0-41d2-93ba-ae42895d418f on hv-cinder-80135 Sep 05 12:36:22.281708 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-c541bd04-da43-418c-8a2a-02007aad23f6 req-a74c7b03-a75e-42fc-8fdc-fa66923909e6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032235 Sep 05 12:36:22.282470 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 444/909] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:36:23.127623 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-baa1a1ae-f5cb-4942-8d55-f3a4857c93e3 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:23.128193 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-baa1a1ae-f5cb-4942-8d55-f3a4857c93e3 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:23.135250 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-baa1a1ae-f5cb-4942-8d55-f3a4857c93e3 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:23.142707 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-baa1a1ae-f5cb-4942-8d55-f3a4857c93e3 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:23.142707 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-baa1a1ae-f5cb-4942-8d55-f3a4857c93e3 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:23.142707 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-baa1a1ae-f5cb-4942-8d55-f3a4857c93e3 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:23.142707 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-baa1a1ae-f5cb-4942-8d55-f3a4857c93e3 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:23.143146 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-baa1a1ae-f5cb-4942-8d55-f3a4857c93e3 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:23.237161 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.objects.instance [None req-baa1a1ae-f5cb-4942-8d55-f3a4857c93e3 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lazy-loading 'services' on Instance uuid 7a8aa06a-9ac0-41d2-93ba-ae42895d418f {{(pid=121211) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:36:23.474667 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-baa1a1ae-f5cb-4942-8d55-f3a4857c93e3 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f/os-volume_attachments/901646c8-b466-43d0-a0aa-487a14805f63" status: 202 len: 0 microversion: 2.1 time: 0.351550 Sep 05 12:36:23.475272 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 466/910] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Sep 5 12:36:23 2022] DELETE /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f/os-volume_attachments/901646c8-b466-43d0-a0aa-487a14805f63 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:36:23.486226 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-b09bf108-3b4f-462a-9934-0dc9d4e876dc tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:23.488615 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-b09bf108-3b4f-462a-9934-0dc9d4e876dc tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:23.495634 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b09bf108-3b4f-462a-9934-0dc9d4e876dc tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:23.502246 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b09bf108-3b4f-462a-9934-0dc9d4e876dc tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:23.502246 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b09bf108-3b4f-462a-9934-0dc9d4e876dc tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:23.502246 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b09bf108-3b4f-462a-9934-0dc9d4e876dc tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:23.502246 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b09bf108-3b4f-462a-9934-0dc9d4e876dc tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:23.502585 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b09bf108-3b4f-462a-9934-0dc9d4e876dc tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:23.529863 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-b09bf108-3b4f-462a-9934-0dc9d4e876dc tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049401 Sep 05 12:36:23.530728 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 445/911] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:36:23 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:36:24.296487 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-2db0f743-95c1-48f1-b8c1-1326e692b781 req-45bd7f4b-bc09-4c57-afc5-9a214b77f18b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8aa06a-9ac0-41d2-93ba-ae42895d418f", "tag": "484ab154-1eb7-4f51-b8a6-351d2c0646e4"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:36:24.307264 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-2db0f743-95c1-48f1-b8c1-1326e692b781 req-45bd7f4b-bc09-4c57-afc5-9a214b77f18b service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:24.307685 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-2db0f743-95c1-48f1-b8c1-1326e692b781 req-45bd7f4b-bc09-4c57-afc5-9a214b77f18b service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:24.308107 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-2db0f743-95c1-48f1-b8c1-1326e692b781 req-45bd7f4b-bc09-4c57-afc5-9a214b77f18b service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:24.320404 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-2db0f743-95c1-48f1-b8c1-1326e692b781 req-45bd7f4b-bc09-4c57-afc5-9a214b77f18b service nova] Creating event network-changed:484ab154-1eb7-4f51-b8a6-351d2c0646e4 for instance 7a8aa06a-9ac0-41d2-93ba-ae42895d418f on hv-cinder-80135 Sep 05 12:36:24.325687 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-2db0f743-95c1-48f1-b8c1-1326e692b781 req-45bd7f4b-bc09-4c57-afc5-9a214b77f18b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033415 Sep 05 12:36:24.326837 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 467/912] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:36:24.412974 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-04c0c4e0-d6ea-45e9-b27d-ca638a01acc5 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:24.413552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-04c0c4e0-d6ea-45e9-b27d-ca638a01acc5 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:24.423100 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-04c0c4e0-d6ea-45e9-b27d-ca638a01acc5 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:24.423100 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-04c0c4e0-d6ea-45e9-b27d-ca638a01acc5 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:24.423100 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-04c0c4e0-d6ea-45e9-b27d-ca638a01acc5 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:24.423100 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-04c0c4e0-d6ea-45e9-b27d-ca638a01acc5 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:24.423684 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-04c0c4e0-d6ea-45e9-b27d-ca638a01acc5 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:24.423684 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-04c0c4e0-d6ea-45e9-b27d-ca638a01acc5 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:24.438330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-04c0c4e0-d6ea-45e9-b27d-ca638a01acc5 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] HTTP exception thrown: Instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 could not be found. Sep 05 12:36:24.442805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-04c0c4e0-d6ea-45e9-b27d-ca638a01acc5 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Request method failure captured: Sep 05 12:36:24.442805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: DELETE /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 HTTP/1.1 Sep 05 12:36:24.442805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:36:24.442805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:36:24.442805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:36:24.442805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:36:24.442805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:36:24.442805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:36:24.442805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:36:24.442805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:36:24.442805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFeufoItTQsL_7sLOi4KSEP2anJWuFcJFO0wxpElVaUiOIZRHfpaIO7Ki-7p9RdECrMyfb98W4yaBOl3v_K7XBLi4W-ns2FJ7XkuNLBlexiQUHW-JFKbXbPcVAg_pV0PiNN_PWY357J1AeDPeP96j3jwWObDa2p7wcvUcxOyeHOpzSuo Sep 05 12:36:24.442805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:36:24.442805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:36:24.442805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:36:24.442805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:36:24.442805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:36:24.442805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:36:24.442805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:36:24.442805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:24.442805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:36:24.442805 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:36:24.444475 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:36:24.444475 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:24.444475 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:36:24.444475 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:24.444475 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:36:24.444475 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:36:24.444475 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:36:24.444475 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: de2273220e824339bd13d968c75df26b Sep 05 12:36:24.444475 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:36:24.444475 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:36:24.444475 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 could not be found. Sep 05 12:36:24.444475 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': '8d037f32-c2bd-4f5e-b99c-de3857df58a5'} Sep 05 12:36:24.446552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:36:24.446552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:24.446552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:36:24.446552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:36:24.446552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:36:24.446552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:36:24.446552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:36:24.446552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:36:24.446552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:36:24.446552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:36:24.446552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 could not be found. Sep 05 12:36:24.446552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:24.446552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:24.446552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:24.446552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:24.446552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:24.446552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:24.446552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:36:24.446552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:36:24.446552 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:36:24.448019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:36:24.448019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 12:36:24.448019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 12:36:24.448019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 12:36:24.448019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 12:36:24.448019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:36:24.448019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:36:24.448019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:36:24.448019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:36:24.448019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 could not be found. Sep 05 12:36:24.448019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:24.448019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:24.448019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:24.448019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:24.448019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:24.448019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:24.448019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:36:24.448019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:36:24.448019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 could not be found. Sep 05 12:36:24.448019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:24.449621 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-04c0c4e0-d6ea-45e9-b27d-ca638a01acc5 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Returning 404 to user: Instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:36:24.449621 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-04c0c4e0-d6ea-45e9-b27d-ca638a01acc5 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5" status: 404 len: 111 microversion: 2.1 time: 0.032610 Sep 05 12:36:24.449621 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 446/913] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:36:24 2022] DELETE /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 05 12:36:24.456554 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f0f33c20-2e33-4a44-b264-abbb8fe4e505 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:24.457247 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f0f33c20-2e33-4a44-b264-abbb8fe4e505 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 8d037f32-c2bd-4f5e-b99c-de3857df58a5] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:24.463425 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f0f33c20-2e33-4a44-b264-abbb8fe4e505 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:24.463970 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f0f33c20-2e33-4a44-b264-abbb8fe4e505 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:24.464383 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f0f33c20-2e33-4a44-b264-abbb8fe4e505 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:24.465084 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f0f33c20-2e33-4a44-b264-abbb8fe4e505 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:24.465540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f0f33c20-2e33-4a44-b264-abbb8fe4e505 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:24.465957 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f0f33c20-2e33-4a44-b264-abbb8fe4e505 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:24.480089 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-f0f33c20-2e33-4a44-b264-abbb8fe4e505 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] HTTP exception thrown: Instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 could not be found. Sep 05 12:36:24.481773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f0f33c20-2e33-4a44-b264-abbb8fe4e505 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Request method failure captured: Sep 05 12:36:24.481773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 HTTP/1.1 Sep 05 12:36:24.481773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:36:24.481773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:36:24.481773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:36:24.481773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:36:24.481773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:36:24.481773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:36:24.481773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:36:24.481773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:36:24.481773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFeufoItTQsL_7sLOi4KSEP2anJWuFcJFO0wxpElVaUiOIZRHfpaIO7Ki-7p9RdECrMyfb98W4yaBOl3v_K7XBLi4W-ns2FJ7XkuNLBlexiQUHW-JFKbXbPcVAg_pV0PiNN_PWY357J1AeDPeP96j3jwWObDa2p7wcvUcxOyeHOpzSuo Sep 05 12:36:24.481773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:36:24.481773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:36:24.481773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:36:24.481773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:36:24.481773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:36:24.481773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:36:24.481773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:36:24.481773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:24.481773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:36:24.481773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:36:24.483384 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:36:24.483384 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:24.483384 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:36:24.483384 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:24.483384 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:36:24.483384 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:36:24.483384 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:36:24.483384 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: de2273220e824339bd13d968c75df26b Sep 05 12:36:24.483384 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:36:24.483384 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: > Sep 05 12:36:24.483384 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 could not be found. Sep 05 12:36:24.483384 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': '8d037f32-c2bd-4f5e-b99c-de3857df58a5'} Sep 05 12:36:24.484521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:36:24.484521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:24.484521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:36:24.484521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:36:24.484521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:36:24.484521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:36:24.484521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:36:24.484521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:36:24.484521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:36:24.484521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:36:24.484521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 could not be found. Sep 05 12:36:24.484521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:24.484521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:24.484521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:24.484521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:24.484521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:24.484521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:24.484521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:36:24.484521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:36:24.484521 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:36:24.486204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:36:24.486204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:36:24.486204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:36:24.486204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:36:24.486204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:36:24.486204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:36:24.486204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:36:24.486204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 could not be found. Sep 05 12:36:24.486204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:24.486204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:24.486204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:24.486204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:24.486204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:24.486204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:24.486204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:36:24.486204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:36:24.486204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 could not be found. Sep 05 12:36:24.486204 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:24.487666 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f0f33c20-2e33-4a44-b264-abbb8fe4e505 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Returning 404 to user: Instance 8d037f32-c2bd-4f5e-b99c-de3857df58a5 could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:36:24.487666 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f0f33c20-2e33-4a44-b264-abbb8fe4e505 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5" status: 404 len: 111 microversion: 2.1 time: 0.031068 Sep 05 12:36:24.487666 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 468/914] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:24 2022] GET /compute/v2.1/servers/8d037f32-c2bd-4f5e-b99c-de3857df58a5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:36:24.543284 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-31cb7cc2-ad21-4793-ab1c-94e0d6452da9 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:24.564671 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-31cb7cc2-ad21-4793-ab1c-94e0d6452da9 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:24.564671 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-31cb7cc2-ad21-4793-ab1c-94e0d6452da9 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:24.564671 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-31cb7cc2-ad21-4793-ab1c-94e0d6452da9 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:24.564671 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-31cb7cc2-ad21-4793-ab1c-94e0d6452da9 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:24.565274 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-31cb7cc2-ad21-4793-ab1c-94e0d6452da9 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:24.565274 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-31cb7cc2-ad21-4793-ab1c-94e0d6452da9 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:24.565274 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-31cb7cc2-ad21-4793-ab1c-94e0d6452da9 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:24.590761 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-31cb7cc2-ad21-4793-ab1c-94e0d6452da9 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051434 Sep 05 12:36:24.591776 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 447/915] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:36:24 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:36:25.603868 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4ba80c9a-b723-4a32-bb31-ad4ff7fae8cd tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:25.606029 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4ba80c9a-b723-4a32-bb31-ad4ff7fae8cd tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:25.612981 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ba80c9a-b723-4a32-bb31-ad4ff7fae8cd tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:25.613583 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ba80c9a-b723-4a32-bb31-ad4ff7fae8cd tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:25.614444 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ba80c9a-b723-4a32-bb31-ad4ff7fae8cd tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:25.614811 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ba80c9a-b723-4a32-bb31-ad4ff7fae8cd tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:25.615438 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ba80c9a-b723-4a32-bb31-ad4ff7fae8cd tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:25.615862 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4ba80c9a-b723-4a32-bb31-ad4ff7fae8cd tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:25.648574 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4ba80c9a-b723-4a32-bb31-ad4ff7fae8cd tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048675 Sep 05 12:36:25.649135 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 469/916] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:36:25 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 05 12:36:25.660494 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-de075b68-b53c-4f06-b6b2-12c0bc386e47 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:25.661087 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-de075b68-b53c-4f06-b6b2-12c0bc386e47 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:25.667632 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-de075b68-b53c-4f06-b6b2-12c0bc386e47 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:25.668121 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-de075b68-b53c-4f06-b6b2-12c0bc386e47 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:25.668554 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-de075b68-b53c-4f06-b6b2-12c0bc386e47 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:25.669249 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-de075b68-b53c-4f06-b6b2-12c0bc386e47 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:25.669698 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-de075b68-b53c-4f06-b6b2-12c0bc386e47 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:25.670142 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-de075b68-b53c-4f06-b6b2-12c0bc386e47 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:25.672952 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:36:25.751027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-de075b68-b53c-4f06-b6b2-12c0bc386e47 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] HTTP exception thrown: Instance 7a8aa06a-9ac0-41d2-93ba-ae42895d418f is not attached to volume 901646c8-b466-43d0-a0aa-487a14805f63 Sep 05 12:36:25.755496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-de075b68-b53c-4f06-b6b2-12c0bc386e47 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Request method failure captured: Sep 05 12:36:25.755496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: DELETE /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f/os-volume_attachments/901646c8-b466-43d0-a0aa-487a14805f63 HTTP/1.1 Sep 05 12:36:25.755496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:36:25.755496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:36:25.755496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:36:25.755496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:36:25.755496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:36:25.755496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:36:25.755496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:36:25.755496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:36:25.755496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFey1hyINKZRPOZCUvSrkamZC49pjEvvBkhfzcH-CwVkbEiFftv6ey79i7HOLwqnY6U9mo1HU_pGH_O0FYEiS1XU-Rq2cy-J_xL0E_XQACDeG1_D06c1lEnen-BeDwWO1jfyIXsmxzIPQcMaexBESRuqkUKGVAWXoZCVwO9z5CTNX1OA Sep 05 12:36:25.755496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:36:25.755496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:36:25.755496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:36:25.755496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:36:25.755496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:36:25.755496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:36:25.755496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 6b86bf1c78d74ceaaff6ead90a70526f Sep 05 12:36:25.755496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-TestMinimumBasicScenario-451770717 Sep 05 12:36:25.755496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:36:25.755496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:36:25.757219 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6b86bf1c78d74ceaaff6ead90a70526f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6b86bf1c78d74ceaaff6ead90a70526f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6b86bf1c78d74ceaaff6ead90a70526f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6b86bf1c78d74ceaaff6ead90a70526f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:36:25.757219 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-TestMinimumBasicScenario-451770717 Sep 05 12:36:25.757219 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 6b86bf1c78d74ceaaff6ead90a70526f Sep 05 12:36:25.757219 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-TestMinimumBasicScenario-451770717 Sep 05 12:36:25.757219 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-TestMinimumBasicScenario-451770717-project Sep 05 12:36:25.757219 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:36:25.757219 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:36:25.757219 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: 087ceea13e3747f49096b42d9d5c1c86 Sep 05 12:36:25.757219 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-TestMinimumBasicScenario-451770717-project Sep 05 12:36:25.757219 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:36:25.757219 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance 7a8aa06a-9ac0-41d2-93ba-ae42895d418f is not attached to volume 901646c8-b466-43d0-a0aa-487a14805f63 Sep 05 12:36:25.758385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'server_id': '7a8aa06a-9ac0-41d2-93ba-ae42895d418f', 'id': '901646c8-b466-43d0-a0aa-487a14805f63'} Sep 05 12:36:25.758385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:36:25.758385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:25.758385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 05 12:36:25.758385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 05 12:36:25.758385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 12:36:25.758385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 12:36:25.758385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 05 12:36:25.758385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 05 12:36:25.758385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 901646c8-b466-43d0-a0aa-487a14805f63. Sep 05 12:36:25.758385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:25.758385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:25.758385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:25.758385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:25.758385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:25.758385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:25.758385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:36:25.758385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:36:25.758385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:36:25.759936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:36:25.759936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 05 12:36:25.759936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 05 12:36:25.759936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a8aa06a-9ac0-41d2-93ba-ae42895d418f is not attached to volume 901646c8-b466-43d0-a0aa-487a14805f63 Sep 05 12:36:25.759936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:25.759936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:25.759936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:25.759936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:25.759936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:25.759936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:25.759936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:36:25.759936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:36:25.759936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a8aa06a-9ac0-41d2-93ba-ae42895d418f is not attached to volume 901646c8-b466-43d0-a0aa-487a14805f63 Sep 05 12:36:25.759936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:25.759936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-de075b68-b53c-4f06-b6b2-12c0bc386e47 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Returning 404 to user: Instance 7a8aa06a-9ac0-41d2-93ba-ae42895d418f is not attached to volume 901646c8-b466-43d0-a0aa-487a14805f63 {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:36:25.761363 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-de075b68-b53c-4f06-b6b2-12c0bc386e47 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f/os-volume_attachments/901646c8-b466-43d0-a0aa-487a14805f63" status: 404 len: 154 microversion: 2.1 time: 0.100533 Sep 05 12:36:25.761363 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 448/917] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Sep 5 12:36:25 2022] DELETE /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f/os-volume_attachments/901646c8-b466-43d0-a0aa-487a14805f63 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:36:25.912697 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8e607306-15a9-4718-9cbd-d0f578539869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:25.914124 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-8e607306-15a9-4718-9cbd-d0f578539869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:25.919439 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8e607306-15a9-4718-9cbd-d0f578539869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:25.920042 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8e607306-15a9-4718-9cbd-d0f578539869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:25.920486 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8e607306-15a9-4718-9cbd-d0f578539869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:25.921190 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8e607306-15a9-4718-9cbd-d0f578539869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:25.921644 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8e607306-15a9-4718-9cbd-d0f578539869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:25.922060 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8e607306-15a9-4718-9cbd-d0f578539869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:25.937019 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-8e607306-15a9-4718-9cbd-d0f578539869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] HTTP exception thrown: Instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 could not be found. Sep 05 12:36:25.938576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8e607306-15a9-4718-9cbd-d0f578539869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Request method failure captured: Sep 05 12:36:25.938576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: DELETE /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 HTTP/1.1 Sep 05 12:36:25.938576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:36:25.938576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:36:25.938576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:36:25.938576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:36:25.938576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:36:25.938576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:36:25.938576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:36:25.938576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:36:25.938576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFeufoItTQsL_7sLOi4KSEP2anJWuFcJFO0wxpElVaUiOIZRHfpaIO7Ki-7p9RdECrMyfb98W4yaBOl3v_K7XBLi4W-ns2FJ7XkuNLBlexiQUHW-JFKbXbPcVAg_pV0PiNN_PWY357J1AeDPeP96j3jwWObDa2p7wcvUcxOyeHOpzSuo Sep 05 12:36:25.938576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:36:25.938576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:36:25.938576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:36:25.938576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:36:25.938576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:36:25.938576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:36:25.938576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:36:25.938576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:25.938576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:36:25.938576 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:36:25.940062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:36:25.940062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:25.940062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:36:25.940062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:25.940062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:36:25.940062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:36:25.940062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:36:25.940062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: de2273220e824339bd13d968c75df26b Sep 05 12:36:25.940062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:36:25.940062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: > Sep 05 12:36:25.940062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 could not be found. Sep 05 12:36:25.940062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': '4d85243e-7c92-4640-8c2d-72c79cf18d76'} Sep 05 12:36:25.941241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:36:25.941241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:25.941241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:36:25.941241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:36:25.941241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:36:25.941241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:36:25.941241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:36:25.941241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:36:25.941241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:36:25.941241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:36:25.941241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 could not be found. Sep 05 12:36:25.941241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:25.941241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:25.941241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:25.941241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:25.941241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:25.941241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:25.941241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:36:25.941241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:36:25.941241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:36:25.942657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:36:25.942657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 12:36:25.942657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 12:36:25.942657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 12:36:25.942657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 12:36:25.942657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:36:25.942657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:36:25.942657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:36:25.942657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:36:25.942657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 could not be found. Sep 05 12:36:25.942657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:25.942657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:25.942657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:25.942657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:25.942657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:25.942657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:25.942657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:36:25.942657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:36:25.942657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 could not be found. Sep 05 12:36:25.942657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:25.944043 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8e607306-15a9-4718-9cbd-d0f578539869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Returning 404 to user: Instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:36:25.944043 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-8e607306-15a9-4718-9cbd-d0f578539869 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 404 len: 111 microversion: 2.1 time: 0.031276 Sep 05 12:36:25.944043 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 470/918] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:36:25 2022] DELETE /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:36:25.949928 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ad120f0f-cabe-4694-a51f-fa388effb677 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:25.950549 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-ad120f0f-cabe-4694-a51f-fa388effb677 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 4d85243e-7c92-4640-8c2d-72c79cf18d76] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:25.958014 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ad120f0f-cabe-4694-a51f-fa388effb677 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:25.958508 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ad120f0f-cabe-4694-a51f-fa388effb677 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:25.958944 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ad120f0f-cabe-4694-a51f-fa388effb677 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:25.959680 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ad120f0f-cabe-4694-a51f-fa388effb677 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:25.960135 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ad120f0f-cabe-4694-a51f-fa388effb677 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:25.960553 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ad120f0f-cabe-4694-a51f-fa388effb677 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:25.974893 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-ad120f0f-cabe-4694-a51f-fa388effb677 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] HTTP exception thrown: Instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 could not be found. Sep 05 12:36:25.976431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ad120f0f-cabe-4694-a51f-fa388effb677 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Request method failure captured: Sep 05 12:36:25.976431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 HTTP/1.1 Sep 05 12:36:25.976431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:36:25.976431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:36:25.976431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:36:25.976431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:36:25.976431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:36:25.976431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:36:25.976431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:36:25.976431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:36:25.976431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFeufoItTQsL_7sLOi4KSEP2anJWuFcJFO0wxpElVaUiOIZRHfpaIO7Ki-7p9RdECrMyfb98W4yaBOl3v_K7XBLi4W-ns2FJ7XkuNLBlexiQUHW-JFKbXbPcVAg_pV0PiNN_PWY357J1AeDPeP96j3jwWObDa2p7wcvUcxOyeHOpzSuo Sep 05 12:36:25.976431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:36:25.976431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:36:25.976431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:36:25.976431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:36:25.976431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:36:25.976431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:36:25.976431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:36:25.976431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:25.976431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:36:25.976431 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:36:25.985262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:36:25.985262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:25.985262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:36:25.985262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:25.985262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:36:25.985262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:36:25.985262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:36:25.985262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: de2273220e824339bd13d968c75df26b Sep 05 12:36:25.985262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:36:25.985262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:36:25.985262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 could not be found. Sep 05 12:36:25.985262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': '4d85243e-7c92-4640-8c2d-72c79cf18d76'} Sep 05 12:36:25.986378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:36:25.986378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:25.986378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:36:25.986378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:36:25.986378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:36:25.986378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:36:25.986378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:36:25.986378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:36:25.986378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:36:25.986378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:36:25.986378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 could not be found. Sep 05 12:36:25.986378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:25.986378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:25.986378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:25.986378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:25.986378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:25.986378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:25.986378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:36:25.986378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:36:25.986378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:36:25.987845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:36:25.987845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:36:25.987845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:36:25.987845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:36:25.987845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:36:25.987845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:36:25.987845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:36:25.987845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 could not be found. Sep 05 12:36:25.987845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:25.987845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:25.987845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:25.987845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:25.987845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:25.987845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:25.987845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:36:25.987845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:36:25.987845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 could not be found. Sep 05 12:36:25.987845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:25.989406 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ad120f0f-cabe-4694-a51f-fa388effb677 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Returning 404 to user: Instance 4d85243e-7c92-4640-8c2d-72c79cf18d76 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:36:25.989406 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-ad120f0f-cabe-4694-a51f-fa388effb677 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76" status: 404 len: 111 microversion: 2.1 time: 0.032204 Sep 05 12:36:25.989406 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 449/919] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:25 2022] GET /compute/v2.1/servers/4d85243e-7c92-4640-8c2d-72c79cf18d76 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:36:25.989689 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3794a639-a230-4a7c-b8aa-d47a839745a2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:25.989689 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-3794a639-a230-4a7c-b8aa-d47a839745a2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:25.994667 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3794a639-a230-4a7c-b8aa-d47a839745a2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:25.995160 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3794a639-a230-4a7c-b8aa-d47a839745a2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:25.995623 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3794a639-a230-4a7c-b8aa-d47a839745a2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:25.996356 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3794a639-a230-4a7c-b8aa-d47a839745a2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:25.996810 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3794a639-a230-4a7c-b8aa-d47a839745a2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:25.997227 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3794a639-a230-4a7c-b8aa-d47a839745a2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:26.011502 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-3794a639-a230-4a7c-b8aa-d47a839745a2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] HTTP exception thrown: Instance fac517b0-9cbe-4a6a-8922-21166ec0de63 could not be found. Sep 05 12:36:26.013101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3794a639-a230-4a7c-b8aa-d47a839745a2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Request method failure captured: Sep 05 12:36:26.013101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: DELETE /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 HTTP/1.1 Sep 05 12:36:26.013101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:36:26.013101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:36:26.013101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:36:26.013101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:36:26.013101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:36:26.013101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:36:26.013101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:36:26.013101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:36:26.013101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFeufoItTQsL_7sLOi4KSEP2anJWuFcJFO0wxpElVaUiOIZRHfpaIO7Ki-7p9RdECrMyfb98W4yaBOl3v_K7XBLi4W-ns2FJ7XkuNLBlexiQUHW-JFKbXbPcVAg_pV0PiNN_PWY357J1AeDPeP96j3jwWObDa2p7wcvUcxOyeHOpzSuo Sep 05 12:36:26.013101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:36:26.013101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:36:26.013101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:36:26.013101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:36:26.013101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:36:26.013101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:36:26.013101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:36:26.013101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:26.013101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:36:26.013101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:36:26.015335 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:36:26.015335 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:26.015335 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:36:26.015335 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:26.015335 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:36:26.015335 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:36:26.015335 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:36:26.015335 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: de2273220e824339bd13d968c75df26b Sep 05 12:36:26.015335 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:36:26.015335 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: > Sep 05 12:36:26.015335 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Instance fac517b0-9cbe-4a6a-8922-21166ec0de63 could not be found. Sep 05 12:36:26.015335 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': 'fac517b0-9cbe-4a6a-8922-21166ec0de63'} Sep 05 12:36:26.016293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:36:26.016293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:26.016293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:36:26.016293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:36:26.016293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:36:26.016293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:36:26.016293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:36:26.016293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:36:26.016293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:36:26.016293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:36:26.016293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fac517b0-9cbe-4a6a-8922-21166ec0de63 could not be found. Sep 05 12:36:26.016293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:26.016293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:26.016293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:26.016293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:26.016293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:26.016293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:26.016293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:36:26.016293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:36:26.016293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:36:26.017515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:36:26.017515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 12:36:26.017515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 12:36:26.017515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 12:36:26.017515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 12:36:26.017515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:36:26.017515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:36:26.017515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:36:26.017515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:36:26.017515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fac517b0-9cbe-4a6a-8922-21166ec0de63 could not be found. Sep 05 12:36:26.017515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:26.017515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:26.017515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:26.017515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:26.017515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:26.017515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:26.017515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:36:26.017515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:36:26.017515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fac517b0-9cbe-4a6a-8922-21166ec0de63 could not be found. Sep 05 12:36:26.017515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:26.018739 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3794a639-a230-4a7c-b8aa-d47a839745a2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Returning 404 to user: Instance fac517b0-9cbe-4a6a-8922-21166ec0de63 could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:36:26.018739 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3794a639-a230-4a7c-b8aa-d47a839745a2 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "DELETE /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 404 len: 111 microversion: 2.1 time: 0.032288 Sep 05 12:36:26.018739 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 471/920] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:36:25 2022] DELETE /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:36:26.024266 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-467c7a38-0489-4c44-bf6e-c7ef6cae95e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:26.024899 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-467c7a38-0489-4c44-bf6e-c7ef6cae95e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: fac517b0-9cbe-4a6a-8922-21166ec0de63] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:26.031362 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-467c7a38-0489-4c44-bf6e-c7ef6cae95e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:26.031874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-467c7a38-0489-4c44-bf6e-c7ef6cae95e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:26.032302 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-467c7a38-0489-4c44-bf6e-c7ef6cae95e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:26.032995 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-467c7a38-0489-4c44-bf6e-c7ef6cae95e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:26.033445 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-467c7a38-0489-4c44-bf6e-c7ef6cae95e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:26.033866 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-467c7a38-0489-4c44-bf6e-c7ef6cae95e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:26.047787 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-467c7a38-0489-4c44-bf6e-c7ef6cae95e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] HTTP exception thrown: Instance fac517b0-9cbe-4a6a-8922-21166ec0de63 could not be found. Sep 05 12:36:26.049398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-467c7a38-0489-4c44-bf6e-c7ef6cae95e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Request method failure captured: Sep 05 12:36:26.049398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 HTTP/1.1 Sep 05 12:36:26.049398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:36:26.049398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:36:26.049398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:36:26.049398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:36:26.049398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:36:26.049398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:36:26.049398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:36:26.049398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:36:26.049398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFeufoItTQsL_7sLOi4KSEP2anJWuFcJFO0wxpElVaUiOIZRHfpaIO7Ki-7p9RdECrMyfb98W4yaBOl3v_K7XBLi4W-ns2FJ7XkuNLBlexiQUHW-JFKbXbPcVAg_pV0PiNN_PWY357J1AeDPeP96j3jwWObDa2p7wcvUcxOyeHOpzSuo Sep 05 12:36:26.049398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:36:26.049398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:36:26.049398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:36:26.049398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:36:26.049398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:36:26.049398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:36:26.049398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:36:26.049398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:26.049398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:36:26.049398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:36:26.050833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:36:26.050833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:26.050833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:36:26.050833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:26.050833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:36:26.050833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:36:26.050833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:36:26.050833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: de2273220e824339bd13d968c75df26b Sep 05 12:36:26.050833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:36:26.050833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:36:26.050833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance fac517b0-9cbe-4a6a-8922-21166ec0de63 could not be found. Sep 05 12:36:26.050833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': 'fac517b0-9cbe-4a6a-8922-21166ec0de63'} Sep 05 12:36:26.054676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:36:26.054676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:26.054676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:36:26.054676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:36:26.054676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:36:26.054676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:36:26.054676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:36:26.054676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:36:26.054676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:36:26.054676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:36:26.054676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fac517b0-9cbe-4a6a-8922-21166ec0de63 could not be found. Sep 05 12:36:26.054676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:26.054676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:26.054676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:26.054676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:26.054676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:26.054676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:26.054676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:36:26.054676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:36:26.054676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:36:26.057124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:36:26.057124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:36:26.057124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:36:26.057124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:36:26.057124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:36:26.057124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:36:26.057124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:36:26.057124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fac517b0-9cbe-4a6a-8922-21166ec0de63 could not be found. Sep 05 12:36:26.057124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:26.057124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:26.057124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:26.057124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:26.057124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:26.057124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:26.057124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:36:26.057124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:36:26.057124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fac517b0-9cbe-4a6a-8922-21166ec0de63 could not be found. Sep 05 12:36:26.057124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:26.058470 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-467c7a38-0489-4c44-bf6e-c7ef6cae95e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Returning 404 to user: Instance fac517b0-9cbe-4a6a-8922-21166ec0de63 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:36:26.058470 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-467c7a38-0489-4c44-bf6e-c7ef6cae95e1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63" status: 404 len: 111 microversion: 2.1 time: 0.031023 Sep 05 12:36:26.058470 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 450/921] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:26 2022] GET /compute/v2.1/servers/fac517b0-9cbe-4a6a-8922-21166ec0de63 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:36:27.029033 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c23d500f-ac87-469c-ad3c-abeaeeef92fc tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:27.029682 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-c23d500f-ac87-469c-ad3c-abeaeeef92fc tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:27.036525 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c23d500f-ac87-469c-ad3c-abeaeeef92fc tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:27.036935 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c23d500f-ac87-469c-ad3c-abeaeeef92fc tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:27.037390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c23d500f-ac87-469c-ad3c-abeaeeef92fc tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:27.038080 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c23d500f-ac87-469c-ad3c-abeaeeef92fc tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:27.038530 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c23d500f-ac87-469c-ad3c-abeaeeef92fc tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:27.038948 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c23d500f-ac87-469c-ad3c-abeaeeef92fc tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:27.065749 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-c23d500f-ac87-469c-ad3c-abeaeeef92fc tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Going to try to terminate instance {{(pid=121211) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:36:27.356724 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d73e6d12-931b-458f-9043-a1847ca6e875 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:27.357233 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d73e6d12-931b-458f-9043-a1847ca6e875 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:27.363949 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d73e6d12-931b-458f-9043-a1847ca6e875 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:27.364427 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d73e6d12-931b-458f-9043-a1847ca6e875 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:27.364853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d73e6d12-931b-458f-9043-a1847ca6e875 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:27.365538 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d73e6d12-931b-458f-9043-a1847ca6e875 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:27.365989 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d73e6d12-931b-458f-9043-a1847ca6e875 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:27.366402 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d73e6d12-931b-458f-9043-a1847ca6e875 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:27.382142 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-d73e6d12-931b-458f-9043-a1847ca6e875 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] HTTP exception thrown: Instance 0815c135-ccc0-412c-b960-1dba28e7b455 could not be found. Sep 05 12:36:27.383858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d73e6d12-931b-458f-9043-a1847ca6e875 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Request method failure captured: Sep 05 12:36:27.383858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: DELETE /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 HTTP/1.1 Sep 05 12:36:27.383858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:36:27.383858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:36:27.383858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:36:27.383858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:36:27.383858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:36:27.383858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:36:27.383858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:36:27.383858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:36:27.383858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFeufoItTQsL_7sLOi4KSEP2anJWuFcJFO0wxpElVaUiOIZRHfpaIO7Ki-7p9RdECrMyfb98W4yaBOl3v_K7XBLi4W-ns2FJ7XkuNLBlexiQUHW-JFKbXbPcVAg_pV0PiNN_PWY357J1AeDPeP96j3jwWObDa2p7wcvUcxOyeHOpzSuo Sep 05 12:36:27.383858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:36:27.383858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:36:27.383858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:36:27.383858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:36:27.383858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:36:27.383858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:36:27.383858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:36:27.383858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:27.383858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:36:27.383858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:36:27.385492 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:36:27.385492 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:27.385492 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:36:27.385492 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:27.385492 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:36:27.385492 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:36:27.385492 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:36:27.385492 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: de2273220e824339bd13d968c75df26b Sep 05 12:36:27.385492 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:36:27.385492 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:36:27.385492 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance 0815c135-ccc0-412c-b960-1dba28e7b455 could not be found. Sep 05 12:36:27.385492 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': '0815c135-ccc0-412c-b960-1dba28e7b455'} Sep 05 12:36:27.386353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:36:27.386353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:27.386353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:36:27.386353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:36:27.386353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:36:27.386353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:36:27.386353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:36:27.386353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:36:27.386353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:36:27.386353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:36:27.386353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0815c135-ccc0-412c-b960-1dba28e7b455 could not be found. Sep 05 12:36:27.386353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:27.386353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:27.386353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:27.386353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:27.386353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:27.386353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:27.386353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:36:27.386353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:36:27.386353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:36:27.387903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:36:27.387903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 12:36:27.387903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 12:36:27.387903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 12:36:27.387903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 12:36:27.387903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:36:27.387903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:36:27.387903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:36:27.387903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:36:27.387903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0815c135-ccc0-412c-b960-1dba28e7b455 could not be found. Sep 05 12:36:27.387903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:27.387903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:27.387903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:27.387903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:27.387903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:27.387903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:27.387903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:36:27.387903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:36:27.387903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0815c135-ccc0-412c-b960-1dba28e7b455 could not be found. Sep 05 12:36:27.387903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:27.389845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d73e6d12-931b-458f-9043-a1847ca6e875 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Returning 404 to user: Instance 0815c135-ccc0-412c-b960-1dba28e7b455 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:36:27.389845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d73e6d12-931b-458f-9043-a1847ca6e875 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 404 len: 111 microversion: 2.1 time: 0.032868 Sep 05 12:36:27.389845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 451/922] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:36:27 2022] DELETE /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 05 12:36:27.393616 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-82900871-321c-490e-8252-1e79106340f1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:27.394219 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-82900871-321c-490e-8252-1e79106340f1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] [instance: 0815c135-ccc0-412c-b960-1dba28e7b455] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:27.400182 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-82900871-321c-490e-8252-1e79106340f1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:27.400663 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-82900871-321c-490e-8252-1e79106340f1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:27.401088 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-82900871-321c-490e-8252-1e79106340f1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:27.401779 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-82900871-321c-490e-8252-1e79106340f1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:27.402229 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-82900871-321c-490e-8252-1e79106340f1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:27.402645 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-82900871-321c-490e-8252-1e79106340f1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:27.418136 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-82900871-321c-490e-8252-1e79106340f1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] HTTP exception thrown: Instance 0815c135-ccc0-412c-b960-1dba28e7b455 could not be found. Sep 05 12:36:27.419756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-82900871-321c-490e-8252-1e79106340f1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Request method failure captured: Sep 05 12:36:27.419756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 HTTP/1.1 Sep 05 12:36:27.419756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:36:27.419756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:36:27.419756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:36:27.419756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:36:27.419756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:36:27.419756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:36:27.419756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:36:27.419756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:36:27.419756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFeufoItTQsL_7sLOi4KSEP2anJWuFcJFO0wxpElVaUiOIZRHfpaIO7Ki-7p9RdECrMyfb98W4yaBOl3v_K7XBLi4W-ns2FJ7XkuNLBlexiQUHW-JFKbXbPcVAg_pV0PiNN_PWY357J1AeDPeP96j3jwWObDa2p7wcvUcxOyeHOpzSuo Sep 05 12:36:27.419756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:36:27.419756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:36:27.419756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:36:27.419756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:36:27.419756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:36:27.419756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:36:27.419756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:36:27.419756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:27.419756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:36:27.419756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:36:27.422037 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4f6830d2e75a47c8a757d4a66c6695ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:36:27.422037 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:27.422037 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 4f6830d2e75a47c8a757d4a66c6695ca Sep 05 12:36:27.422037 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1257908254 Sep 05 12:36:27.422037 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:36:27.422037 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:36:27.422037 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:36:27.422037 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: de2273220e824339bd13d968c75df26b Sep 05 12:36:27.422037 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-AttachVolumeNegativeTest-1257908254-project Sep 05 12:36:27.422037 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:36:27.422037 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance 0815c135-ccc0-412c-b960-1dba28e7b455 could not be found. Sep 05 12:36:27.422037 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': '0815c135-ccc0-412c-b960-1dba28e7b455'} Sep 05 12:36:27.423032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:36:27.423032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:27.423032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:36:27.423032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:36:27.423032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:36:27.423032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:36:27.423032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:36:27.423032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:36:27.423032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:36:27.423032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:36:27.423032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0815c135-ccc0-412c-b960-1dba28e7b455 could not be found. Sep 05 12:36:27.423032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:27.423032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:27.423032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:27.423032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:27.423032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:27.423032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:27.423032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:36:27.423032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:36:27.423032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:36:27.424686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:36:27.424686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:36:27.424686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:36:27.424686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:36:27.424686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:36:27.424686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:36:27.424686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:36:27.424686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0815c135-ccc0-412c-b960-1dba28e7b455 could not be found. Sep 05 12:36:27.424686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:27.424686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:27.424686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:27.424686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:27.424686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:27.424686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:27.424686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:36:27.424686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:36:27.424686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0815c135-ccc0-412c-b960-1dba28e7b455 could not be found. Sep 05 12:36:27.424686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:27.426088 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-82900871-321c-490e-8252-1e79106340f1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] Returning 404 to user: Instance 0815c135-ccc0-412c-b960-1dba28e7b455 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:36:27.426088 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-82900871-321c-490e-8252-1e79106340f1 tempest-AttachVolumeNegativeTest-1257908254 tempest-AttachVolumeNegativeTest-1257908254-project] 10.222.0.62 "GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455" status: 404 len: 111 microversion: 2.1 time: 0.031881 Sep 05 12:36:27.426290 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-c23d500f-ac87-469c-ad3c-abeaeeef92fc tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 204 len: 0 microversion: 2.1 time: 0.398224 Sep 05 12:36:27.426290 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 472/923] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:36:27 2022] DELETE /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:36:27.426475 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 452/924] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:27 2022] GET /compute/v2.1/servers/0815c135-ccc0-412c-b960-1dba28e7b455 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 05 12:36:27.438775 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-43982226-b936-4973-a423-3088b7890e89 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:27.438775 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-43982226-b936-4973-a423-3088b7890e89 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:27.440210 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-43982226-b936-4973-a423-3088b7890e89 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:27.440729 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-43982226-b936-4973-a423-3088b7890e89 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:27.441171 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-43982226-b936-4973-a423-3088b7890e89 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:27.441876 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-43982226-b936-4973-a423-3088b7890e89 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:27.442329 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-43982226-b936-4973-a423-3088b7890e89 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:27.442756 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-43982226-b936-4973-a423-3088b7890e89 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:27.585637 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-43982226-b936-4973-a423-3088b7890e89 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:27.594656 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-43982226-b936-4973-a423-3088b7890e89 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1553 microversion: 2.1 time: 0.166006 Sep 05 12:36:27.595206 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 473/925] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:27 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:28.621172 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-987dc6c6-5e14-43eb-802a-266af32b2664 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:28.621801 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-987dc6c6-5e14-43eb-802a-266af32b2664 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:28.629262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-987dc6c6-5e14-43eb-802a-266af32b2664 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:28.629741 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-987dc6c6-5e14-43eb-802a-266af32b2664 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:28.630626 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-987dc6c6-5e14-43eb-802a-266af32b2664 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:28.631601 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-987dc6c6-5e14-43eb-802a-266af32b2664 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:28.632121 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-987dc6c6-5e14-43eb-802a-266af32b2664 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:28.632689 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-987dc6c6-5e14-43eb-802a-266af32b2664 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:28.876365 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-987dc6c6-5e14-43eb-802a-266af32b2664 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:28.884245 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-987dc6c6-5e14-43eb-802a-266af32b2664 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1553 microversion: 2.1 time: 0.267315 Sep 05 12:36:28.884816 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 453/926] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:28 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1553 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:29.908579 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-66c81831-3886-4195-9a59-264f924d06e9 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:29.909305 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-66c81831-3886-4195-9a59-264f924d06e9 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:29.916689 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-66c81831-3886-4195-9a59-264f924d06e9 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:29.917596 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-66c81831-3886-4195-9a59-264f924d06e9 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:29.918288 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-66c81831-3886-4195-9a59-264f924d06e9 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:29.919299 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-66c81831-3886-4195-9a59-264f924d06e9 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:29.920088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-66c81831-3886-4195-9a59-264f924d06e9 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:29.920783 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-66c81831-3886-4195-9a59-264f924d06e9 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:30.370425 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-66c81831-3886-4195-9a59-264f924d06e9 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:30.379975 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-66c81831-3886-4195-9a59-264f924d06e9 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1553 microversion: 2.1 time: 0.475359 Sep 05 12:36:30.383158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 474/927] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:29 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1553 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:30.528578 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-dcc6962d-7e1f-4924-ac34-efdeffd3b42a req-8d582d02-b50c-432e-b119-d5b784040779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8aa06a-9ac0-41d2-93ba-ae42895d418f", "name": "network-vif-deleted", "tag": "484ab154-1eb7-4f51-b8a6-351d2c0646e4"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:36:30.539247 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-dcc6962d-7e1f-4924-ac34-efdeffd3b42a req-8d582d02-b50c-432e-b119-d5b784040779 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:30.540326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-dcc6962d-7e1f-4924-ac34-efdeffd3b42a req-8d582d02-b50c-432e-b119-d5b784040779 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:30.540326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-dcc6962d-7e1f-4924-ac34-efdeffd3b42a req-8d582d02-b50c-432e-b119-d5b784040779 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:30.553433 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-dcc6962d-7e1f-4924-ac34-efdeffd3b42a req-8d582d02-b50c-432e-b119-d5b784040779 service nova] Creating event network-vif-deleted:484ab154-1eb7-4f51-b8a6-351d2c0646e4 for instance 7a8aa06a-9ac0-41d2-93ba-ae42895d418f on hv-cinder-80135 Sep 05 12:36:30.558957 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-dcc6962d-7e1f-4924-ac34-efdeffd3b42a req-8d582d02-b50c-432e-b119-d5b784040779 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033929 Sep 05 12:36:30.559572 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 454/928] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:36:31.407528 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4f14b1fd-1e4c-4126-867b-868b01a9c28a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:31.408309 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4f14b1fd-1e4c-4126-867b-868b01a9c28a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:31.414864 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4f14b1fd-1e4c-4126-867b-868b01a9c28a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:31.415346 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4f14b1fd-1e4c-4126-867b-868b01a9c28a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:31.415808 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4f14b1fd-1e4c-4126-867b-868b01a9c28a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:31.416803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4f14b1fd-1e4c-4126-867b-868b01a9c28a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:31.417428 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4f14b1fd-1e4c-4126-867b-868b01a9c28a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:31.417858 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4f14b1fd-1e4c-4126-867b-868b01a9c28a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:31.438344 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:36:31.451478 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4f14b1fd-1e4c-4126-867b-868b01a9c28a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:31.452249 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4f14b1fd-1e4c-4126-867b-868b01a9c28a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:31.452678 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4f14b1fd-1e4c-4126-867b-868b01a9c28a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:31.453131 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.objects.instance [None req-4f14b1fd-1e4c-4126-867b-868b01a9c28a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lazy-loading 'fault' on Instance uuid 7a8aa06a-9ac0-41d2-93ba-ae42895d418f {{(pid=121211) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:36:31.515883 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-4f14b1fd-1e4c-4126-867b-868b01a9c28a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ceea13e3747f49096b42d9d5c1c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b86bf1c78d74ceaaff6ead90a70526f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:31.518701 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4f14b1fd-1e4c-4126-867b-868b01a9c28a tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 200 len: 1348 microversion: 2.1 time: 0.115647 Sep 05 12:36:31.519495 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 475/929] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:31 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 1348 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:32.545148 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ccb292dc-c222-41ec-84cd-32b4d1037cab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:32.545975 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-ccb292dc-c222-41ec-84cd-32b4d1037cab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] [instance: 7a8aa06a-9ac0-41d2-93ba-ae42895d418f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:32.553886 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ccb292dc-c222-41ec-84cd-32b4d1037cab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:32.556121 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ccb292dc-c222-41ec-84cd-32b4d1037cab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:32.556121 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ccb292dc-c222-41ec-84cd-32b4d1037cab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:32.556121 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ccb292dc-c222-41ec-84cd-32b4d1037cab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:32.564647 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ccb292dc-c222-41ec-84cd-32b4d1037cab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:32.565090 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ccb292dc-c222-41ec-84cd-32b4d1037cab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:32.581130 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-ccb292dc-c222-41ec-84cd-32b4d1037cab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] HTTP exception thrown: Instance 7a8aa06a-9ac0-41d2-93ba-ae42895d418f could not be found. Sep 05 12:36:32.582874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ccb292dc-c222-41ec-84cd-32b4d1037cab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Request method failure captured: Sep 05 12:36:32.582874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f HTTP/1.1 Sep 05 12:36:32.582874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:36:32.582874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:36:32.582874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:36:32.582874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:36:32.582874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:36:32.582874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:36:32.582874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:36:32.582874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:36:32.582874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFey1hyINKZRPOZCUvSrkamZC49pjEvvBkhfzcH-CwVkbEiFftv6ey79i7HOLwqnY6U9mo1HU_pGH_O0FYEiS1XU-Rq2cy-J_xL0E_XQACDeG1_D06c1lEnen-BeDwWO1jfyIXsmxzIPQcMaexBESRuqkUKGVAWXoZCVwO9z5CTNX1OA Sep 05 12:36:32.582874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:36:32.582874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:36:32.582874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:36:32.582874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:36:32.582874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:36:32.582874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:36:32.582874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 6b86bf1c78d74ceaaff6ead90a70526f Sep 05 12:36:32.582874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-TestMinimumBasicScenario-451770717 Sep 05 12:36:32.582874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:36:32.582874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:36:32.584675 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6b86bf1c78d74ceaaff6ead90a70526f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6b86bf1c78d74ceaaff6ead90a70526f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6b86bf1c78d74ceaaff6ead90a70526f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6b86bf1c78d74ceaaff6ead90a70526f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:36:32.584675 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-TestMinimumBasicScenario-451770717 Sep 05 12:36:32.584675 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 6b86bf1c78d74ceaaff6ead90a70526f Sep 05 12:36:32.584675 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-TestMinimumBasicScenario-451770717 Sep 05 12:36:32.584675 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-TestMinimumBasicScenario-451770717-project Sep 05 12:36:32.584675 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:36:32.584675 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:36:32.584675 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: 087ceea13e3747f49096b42d9d5c1c86 Sep 05 12:36:32.584675 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-TestMinimumBasicScenario-451770717-project Sep 05 12:36:32.584675 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:36:32.584675 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance 7a8aa06a-9ac0-41d2-93ba-ae42895d418f could not be found. Sep 05 12:36:32.584675 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': '7a8aa06a-9ac0-41d2-93ba-ae42895d418f'} Sep 05 12:36:32.585574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:36:32.585574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:32.585574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:36:32.585574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:36:32.585574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:36:32.585574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:36:32.585574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:36:32.585574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:36:32.585574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:36:32.585574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:36:32.585574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a8aa06a-9ac0-41d2-93ba-ae42895d418f could not be found. Sep 05 12:36:32.585574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:32.585574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:32.585574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:32.585574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:32.585574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:32.585574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:32.585574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:36:32.585574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:36:32.585574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:36:32.587027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:36:32.587027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:36:32.587027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:36:32.587027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:36:32.587027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:36:32.587027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:36:32.587027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:36:32.587027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a8aa06a-9ac0-41d2-93ba-ae42895d418f could not be found. Sep 05 12:36:32.587027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:32.587027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:32.587027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:32.587027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:32.587027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:32.587027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:32.587027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:36:32.587027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:36:32.587027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a8aa06a-9ac0-41d2-93ba-ae42895d418f could not be found. Sep 05 12:36:32.587027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:32.588313 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ccb292dc-c222-41ec-84cd-32b4d1037cab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Returning 404 to user: Instance 7a8aa06a-9ac0-41d2-93ba-ae42895d418f could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:36:32.588313 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-ccb292dc-c222-41ec-84cd-32b4d1037cab tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f" status: 404 len: 111 microversion: 2.1 time: 0.043736 Sep 05 12:36:32.588467 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 455/930] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:36:32 2022] GET /compute/v2.1/servers/7a8aa06a-9ac0-41d2-93ba-ae42895d418f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:36:32.594167 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-bacfd628-4fa4-48a6-9c59-e2cb12bbf978 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] Calling method '.version_select at 0x7fe71283b670>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:32.675164 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-bacfd628-4fa4-48a6-9c59-e2cb12bbf978 tempest-TestMinimumBasicScenario-451770717 tempest-TestMinimumBasicScenario-451770717-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1102826235" status: 202 len: 0 microversion: 2.1 time: 0.085700 Sep 05 12:36:32.676148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 476/931] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Sep 5 12:36:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1102826235 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 05 12:36:37.560563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-2c121beb-116c-422f-8325-d50a6132ab16 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:37.563343 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-2c121beb-116c-422f-8325-d50a6132ab16 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:37.570236 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2c121beb-116c-422f-8325-d50a6132ab16 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:37.570940 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2c121beb-116c-422f-8325-d50a6132ab16 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:37.571655 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2c121beb-116c-422f-8325-d50a6132ab16 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:37.572583 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2c121beb-116c-422f-8325-d50a6132ab16 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:37.573248 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2c121beb-116c-422f-8325-d50a6132ab16 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:37.573855 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2c121beb-116c-422f-8325-d50a6132ab16 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:37.610667 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-2c121beb-116c-422f-8325-d50a6132ab16 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053953 Sep 05 12:36:37.611875 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 456/932] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Sep 5 12:36:37 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:36:37.696916 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-cd624238-fce5-4b7d-8ee1-db9d208c6f84 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:37.697928 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-cd624238-fce5-4b7d-8ee1-db9d208c6f84 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:37.710448 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cd624238-fce5-4b7d-8ee1-db9d208c6f84 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:37.711325 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cd624238-fce5-4b7d-8ee1-db9d208c6f84 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:37.712154 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cd624238-fce5-4b7d-8ee1-db9d208c6f84 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:37.713645 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cd624238-fce5-4b7d-8ee1-db9d208c6f84 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:37.714961 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cd624238-fce5-4b7d-8ee1-db9d208c6f84 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:37.715987 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cd624238-fce5-4b7d-8ee1-db9d208c6f84 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:37.783165 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-cd624238-fce5-4b7d-8ee1-db9d208c6f84 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Going to try to terminate instance {{(pid=121211) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:36:38.095140 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-cd624238-fce5-4b7d-8ee1-db9d208c6f84 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "DELETE /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 204 len: 0 microversion: 2.20 time: 0.403815 Sep 05 12:36:38.095844 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 477/933] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Sep 5 12:36:37 2022] DELETE /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 05 12:36:38.105966 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-bfb2708b-6de0-4e98-a389-bdd2c81bc5ec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:38.106679 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-bfb2708b-6de0-4e98-a389-bdd2c81bc5ec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:38.113734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bfb2708b-6de0-4e98-a389-bdd2c81bc5ec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:38.114249 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bfb2708b-6de0-4e98-a389-bdd2c81bc5ec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:38.114704 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bfb2708b-6de0-4e98-a389-bdd2c81bc5ec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:38.115406 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bfb2708b-6de0-4e98-a389-bdd2c81bc5ec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:38.115889 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bfb2708b-6de0-4e98-a389-bdd2c81bc5ec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:38.116328 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bfb2708b-6de0-4e98-a389-bdd2c81bc5ec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:38.357967 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-bfb2708b-6de0-4e98-a389-bdd2c81bc5ec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:38.374438 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-bfb2708b-6de0-4e98-a389-bdd2c81bc5ec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:38.374438 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-bfb2708b-6de0-4e98-a389-bdd2c81bc5ec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:38.374438 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-bfb2708b-6de0-4e98-a389-bdd2c81bc5ec tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1724 microversion: 2.20 time: 0.268391 Sep 05 12:36:38.374945 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 457/934] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:36:38 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:36:39.397807 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-34592d71-7434-41d0-84e5-11abd95b3fd5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:39.399124 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-34592d71-7434-41d0-84e5-11abd95b3fd5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:39.406519 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-34592d71-7434-41d0-84e5-11abd95b3fd5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:39.407016 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-34592d71-7434-41d0-84e5-11abd95b3fd5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:39.407455 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-34592d71-7434-41d0-84e5-11abd95b3fd5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:39.408256 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-34592d71-7434-41d0-84e5-11abd95b3fd5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:39.408720 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-34592d71-7434-41d0-84e5-11abd95b3fd5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:39.409163 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-34592d71-7434-41d0-84e5-11abd95b3fd5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:39.552301 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-34592d71-7434-41d0-84e5-11abd95b3fd5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:39.562003 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-34592d71-7434-41d0-84e5-11abd95b3fd5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:39.564111 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-34592d71-7434-41d0-84e5-11abd95b3fd5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:39.565342 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-34592d71-7434-41d0-84e5-11abd95b3fd5 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1724 microversion: 2.20 time: 0.171968 Sep 05 12:36:39.566346 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 478/935] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:36:39 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:36:40.592690 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-abac9c96-975c-4db5-b16b-13a7d87c0c70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:40.593298 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-abac9c96-975c-4db5-b16b-13a7d87c0c70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:40.599796 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-abac9c96-975c-4db5-b16b-13a7d87c0c70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:40.600271 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-abac9c96-975c-4db5-b16b-13a7d87c0c70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:40.600697 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-abac9c96-975c-4db5-b16b-13a7d87c0c70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:40.601379 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-abac9c96-975c-4db5-b16b-13a7d87c0c70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:40.601824 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-abac9c96-975c-4db5-b16b-13a7d87c0c70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:40.602287 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-abac9c96-975c-4db5-b16b-13a7d87c0c70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:40.875191 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-abac9c96-975c-4db5-b16b-13a7d87c0c70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:40.884512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-abac9c96-975c-4db5-b16b-13a7d87c0c70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:40.885971 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-abac9c96-975c-4db5-b16b-13a7d87c0c70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:40.887138 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-abac9c96-975c-4db5-b16b-13a7d87c0c70 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1724 microversion: 2.20 time: 0.298670 Sep 05 12:36:40.888099 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 458/936] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:36:40 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1724 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:36:41.914537 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-6c897f4e-c3d4-4dff-a249-82324677b541 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:41.915272 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-6c897f4e-c3d4-4dff-a249-82324677b541 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:41.922837 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c897f4e-c3d4-4dff-a249-82324677b541 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:41.923345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c897f4e-c3d4-4dff-a249-82324677b541 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:41.923814 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c897f4e-c3d4-4dff-a249-82324677b541 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:41.924530 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c897f4e-c3d4-4dff-a249-82324677b541 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:41.924979 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c897f4e-c3d4-4dff-a249-82324677b541 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:41.925711 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c897f4e-c3d4-4dff-a249-82324677b541 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:42.457675 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6c897f4e-c3d4-4dff-a249-82324677b541 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:42.466583 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6c897f4e-c3d4-4dff-a249-82324677b541 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:42.468171 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6c897f4e-c3d4-4dff-a249-82324677b541 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:42.469430 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-6c897f4e-c3d4-4dff-a249-82324677b541 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1724 microversion: 2.20 time: 0.558922 Sep 05 12:36:42.469991 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 479/937] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:36:41 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1724 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:36:43.438700 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-594991b6-ff99-41dd-9232-b1236aa7563c req-c31c254c-049e-4146-af45-fa9af2e252ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "407e87bb-faeb-4ba6-b6dc-e9b7a3690356", "name": "network-vif-deleted", "tag": "3c7003e7-309e-4432-9c69-6cc1517fcb8d"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:36:43.462538 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-594991b6-ff99-41dd-9232-b1236aa7563c req-c31c254c-049e-4146-af45-fa9af2e252ba service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:43.463453 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-594991b6-ff99-41dd-9232-b1236aa7563c req-c31c254c-049e-4146-af45-fa9af2e252ba service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:43.464625 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-594991b6-ff99-41dd-9232-b1236aa7563c req-c31c254c-049e-4146-af45-fa9af2e252ba service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:43.477388 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-594991b6-ff99-41dd-9232-b1236aa7563c req-c31c254c-049e-4146-af45-fa9af2e252ba service nova] Creating event network-vif-deleted:3c7003e7-309e-4432-9c69-6cc1517fcb8d for instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 on hv-cinder-80135 Sep 05 12:36:43.484062 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-594991b6-ff99-41dd-9232-b1236aa7563c req-c31c254c-049e-4146-af45-fa9af2e252ba service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049432 Sep 05 12:36:43.491422 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 459/938] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:36:43.495925 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-b08b75ae-1a7b-4237-bbe3-533ac2612e37 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:43.496680 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-b08b75ae-1a7b-4237-bbe3-533ac2612e37 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:43.504528 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b08b75ae-1a7b-4237-bbe3-533ac2612e37 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:43.505996 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b08b75ae-1a7b-4237-bbe3-533ac2612e37 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:43.507218 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b08b75ae-1a7b-4237-bbe3-533ac2612e37 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:43.509214 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b08b75ae-1a7b-4237-bbe3-533ac2612e37 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:43.510527 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b08b75ae-1a7b-4237-bbe3-533ac2612e37 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:43.511483 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b08b75ae-1a7b-4237-bbe3-533ac2612e37 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:43.608368 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-b08b75ae-1a7b-4237-bbe3-533ac2612e37 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:43.618746 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-b08b75ae-1a7b-4237-bbe3-533ac2612e37 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:43.620378 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-b08b75ae-1a7b-4237-bbe3-533ac2612e37 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:43.621631 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-b08b75ae-1a7b-4237-bbe3-533ac2612e37 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1656 microversion: 2.20 time: 0.131055 Sep 05 12:36:43.636013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 480/939] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:36:43 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1656 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:36:44.649244 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-5a93c85b-7514-441d-bc8c-ec1dc3ccfb80 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:44.652449 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-5a93c85b-7514-441d-bc8c-ec1dc3ccfb80 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:44.663709 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5a93c85b-7514-441d-bc8c-ec1dc3ccfb80 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:44.664581 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5a93c85b-7514-441d-bc8c-ec1dc3ccfb80 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:44.665269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5a93c85b-7514-441d-bc8c-ec1dc3ccfb80 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:44.666167 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5a93c85b-7514-441d-bc8c-ec1dc3ccfb80 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:44.666684 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5a93c85b-7514-441d-bc8c-ec1dc3ccfb80 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:44.668461 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5a93c85b-7514-441d-bc8c-ec1dc3ccfb80 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:44.708768 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5a93c85b-7514-441d-bc8c-ec1dc3ccfb80 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:44.709253 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5a93c85b-7514-441d-bc8c-ec1dc3ccfb80 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:44.709732 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5a93c85b-7514-441d-bc8c-ec1dc3ccfb80 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:44.710160 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-5a93c85b-7514-441d-bc8c-ec1dc3ccfb80 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lazy-loading 'fault' on Instance uuid 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:36:44.753830 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-5a93c85b-7514-441d-bc8c-ec1dc3ccfb80 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:44.761780 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-5a93c85b-7514-441d-bc8c-ec1dc3ccfb80 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:44.763218 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-5a93c85b-7514-441d-bc8c-ec1dc3ccfb80 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a61a18900c44bea89647fc9ccdaf110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094bae935a1e4738b0c51d33c6d89e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:36:44.764762 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-5a93c85b-7514-441d-bc8c-ec1dc3ccfb80 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 200 len: 1371 microversion: 2.20 time: 0.120713 Sep 05 12:36:44.767275 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 460/940] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:36:44 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 1371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 12:36:45.790684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-6eaa0483-110d-4a24-a3a5-3e580b786b1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:45.791472 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-6eaa0483-110d-4a24-a3a5-3e580b786b1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:45.793676 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:36:45.799072 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6eaa0483-110d-4a24-a3a5-3e580b786b1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:45.805408 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6eaa0483-110d-4a24-a3a5-3e580b786b1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:45.805408 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6eaa0483-110d-4a24-a3a5-3e580b786b1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:45.805408 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6eaa0483-110d-4a24-a3a5-3e580b786b1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:45.805408 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6eaa0483-110d-4a24-a3a5-3e580b786b1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:45.805756 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6eaa0483-110d-4a24-a3a5-3e580b786b1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:45.815456 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-6eaa0483-110d-4a24-a3a5-3e580b786b1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] HTTP exception thrown: Instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 could not be found. Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-6eaa0483-110d-4a24-a3a5-3e580b786b1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Request method failure captured: Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 HTTP/1.1 Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFeumSnTBVkpu6EglMHsXvEVreXN-ecouhECu3sHOydWwJQRqKYX1IbEHpcAOyupR0JZoOfJ4jP5Lfc7EWbVrDYx3pQNVWC2NDPZBKY-A_4JgQatZjCmiIQ9G2aOG3eLH761jTySfb7t7bz2LqLlcg7u8hqJHs9MYVXH-i6LHBelxddU Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 094bae935a1e4738b0c51d33c6d89e3a Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-793258417 Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:36:45.817123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:36:45.818895 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:36:45.818895 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-AttachVolumeShelveTestJSON-793258417 Sep 05 12:36:45.818895 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 094bae935a1e4738b0c51d33c6d89e3a Sep 05 12:36:45.818895 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-793258417 Sep 05 12:36:45.818895 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-AttachVolumeShelveTestJSON-793258417-project Sep 05 12:36:45.818895 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:36:45.818895 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:36:45.818895 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: 9a61a18900c44bea89647fc9ccdaf110 Sep 05 12:36:45.818895 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-AttachVolumeShelveTestJSON-793258417-project Sep 05 12:36:45.818895 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: > Sep 05 12:36:45.818895 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 could not be found. Sep 05 12:36:45.818895 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': '407e87bb-faeb-4ba6-b6dc-e9b7a3690356'} Sep 05 12:36:45.820047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:36:45.820047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:45.820047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:36:45.820047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:36:45.820047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:36:45.820047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:36:45.820047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:36:45.820047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:36:45.820047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:36:45.820047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:36:45.820047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 could not be found. Sep 05 12:36:45.820047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:45.820047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:45.820047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:45.820047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:45.820047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:45.820047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:45.820047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:36:45.820047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:36:45.820047 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:36:45.821556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:36:45.821556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:36:45.821556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:36:45.821556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:36:45.821556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:36:45.821556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:36:45.821556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:36:45.821556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 could not be found. Sep 05 12:36:45.821556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:45.821556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:45.821556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:45.821556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:45.821556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:45.821556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:45.821556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:36:45.821556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:36:45.821556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 could not be found. Sep 05 12:36:45.821556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:45.822853 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-6eaa0483-110d-4a24-a3a5-3e580b786b1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Returning 404 to user: Instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:36:45.822853 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-6eaa0483-110d-4a24-a3a5-3e580b786b1d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 404 len: 111 microversion: 2.20 time: 0.032226 Sep 05 12:36:45.822853 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 481/941] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:36:45 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 05 12:36:45.827804 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-b2f35b9a-1500-43d0-b059-0ede5345358c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '.version_select at 0x7fe71294f700>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:45.904774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-b2f35b9a-1500-43d0-b059-0ede5345358c tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-845969821" status: 204 len: 0 microversion: 2.20 time: 0.080831 Sep 05 12:36:45.905396 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 461/942] 10.222.0.62 () {60 vars in 1259 bytes} [Mon Sep 5 12:36:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-845969821 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 05 12:36:47.927552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-b8ad2df0-1d32-4625-af95-f60959b46957 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:47.928134 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-b8ad2df0-1d32-4625-af95-f60959b46957 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:47.934994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b8ad2df0-1d32-4625-af95-f60959b46957 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:47.935476 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b8ad2df0-1d32-4625-af95-f60959b46957 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:47.935943 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b8ad2df0-1d32-4625-af95-f60959b46957 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:47.936696 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b8ad2df0-1d32-4625-af95-f60959b46957 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:47.937152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b8ad2df0-1d32-4625-af95-f60959b46957 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:47.937610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b8ad2df0-1d32-4625-af95-f60959b46957 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:47.950874 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-b8ad2df0-1d32-4625-af95-f60959b46957 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] HTTP exception thrown: Instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 could not be found. Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-b8ad2df0-1d32-4625-af95-f60959b46957 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Request method failure captured: Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: DELETE /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 HTTP/1.1 Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFeumSnTBVkpu6EglMHsXvEVreXN-ecouhECu3sHOydWwJQRqKYX1IbEHpcAOyupR0JZoOfJ4jP5Lfc7EWbVrDYx3pQNVWC2NDPZBKY-A_4JgQatZjCmiIQ9G2aOG3eLH761jTySfb7t7bz2LqLlcg7u8hqJHs9MYVXH-i6LHBelxddU Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 094bae935a1e4738b0c51d33c6d89e3a Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-793258417 Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:36:47.952467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:36:47.954655 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:36:47.954655 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-AttachVolumeShelveTestJSON-793258417 Sep 05 12:36:47.954655 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 094bae935a1e4738b0c51d33c6d89e3a Sep 05 12:36:47.954655 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-793258417 Sep 05 12:36:47.954655 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-AttachVolumeShelveTestJSON-793258417-project Sep 05 12:36:47.954655 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:36:47.954655 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:36:47.954655 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: 9a61a18900c44bea89647fc9ccdaf110 Sep 05 12:36:47.954655 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-AttachVolumeShelveTestJSON-793258417-project Sep 05 12:36:47.954655 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: > Sep 05 12:36:47.954655 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 could not be found. Sep 05 12:36:47.954655 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': '407e87bb-faeb-4ba6-b6dc-e9b7a3690356'} Sep 05 12:36:47.955585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:36:47.955585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:47.955585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:36:47.955585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:36:47.955585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:36:47.955585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:36:47.955585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:36:47.955585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:36:47.955585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:36:47.955585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:36:47.955585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 could not be found. Sep 05 12:36:47.955585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:47.955585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:47.955585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:47.955585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:47.955585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:47.955585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:47.955585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:36:47.955585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:36:47.955585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:36:47.957148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:36:47.957148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 12:36:47.957148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 12:36:47.957148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 12:36:47.957148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 12:36:47.957148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:36:47.957148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:36:47.957148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:36:47.957148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:36:47.957148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 could not be found. Sep 05 12:36:47.957148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:47.957148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:47.957148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:47.957148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:47.957148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:47.957148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:47.957148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:36:47.957148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:36:47.957148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 could not be found. Sep 05 12:36:47.957148 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:47.958864 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-b8ad2df0-1d32-4625-af95-f60959b46957 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Returning 404 to user: Instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:36:47.958864 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-b8ad2df0-1d32-4625-af95-f60959b46957 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "DELETE /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 404 len: 111 microversion: 2.20 time: 0.031248 Sep 05 12:36:47.958864 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 482/943] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Sep 5 12:36:47 2022] DELETE /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 05 12:36:47.964085 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-509b5a9e-f9a4-4f84-9e1a-c6fbfffc930d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:47.964842 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-509b5a9e-f9a4-4f84-9e1a-c6fbfffc930d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: 407e87bb-faeb-4ba6-b6dc-e9b7a3690356] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:47.966620 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:36:47.972636 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-509b5a9e-f9a4-4f84-9e1a-c6fbfffc930d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:47.973147 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-509b5a9e-f9a4-4f84-9e1a-c6fbfffc930d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:47.973577 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-509b5a9e-f9a4-4f84-9e1a-c6fbfffc930d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:47.974271 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-509b5a9e-f9a4-4f84-9e1a-c6fbfffc930d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:47.974725 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-509b5a9e-f9a4-4f84-9e1a-c6fbfffc930d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:47.975147 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-509b5a9e-f9a4-4f84-9e1a-c6fbfffc930d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:47.988606 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-509b5a9e-f9a4-4f84-9e1a-c6fbfffc930d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] HTTP exception thrown: Instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 could not be found. Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-509b5a9e-f9a4-4f84-9e1a-c6fbfffc930d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Request method failure captured: Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 HTTP/1.1 Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFeumSnTBVkpu6EglMHsXvEVreXN-ecouhECu3sHOydWwJQRqKYX1IbEHpcAOyupR0JZoOfJ4jP5Lfc7EWbVrDYx3pQNVWC2NDPZBKY-A_4JgQatZjCmiIQ9G2aOG3eLH761jTySfb7t7bz2LqLlcg7u8hqJHs9MYVXH-i6LHBelxddU Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 094bae935a1e4738b0c51d33c6d89e3a Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-793258417 Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:36:47.990319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:36:47.991961 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:36:47.991961 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-AttachVolumeShelveTestJSON-793258417 Sep 05 12:36:47.991961 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 094bae935a1e4738b0c51d33c6d89e3a Sep 05 12:36:47.991961 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-793258417 Sep 05 12:36:47.991961 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-AttachVolumeShelveTestJSON-793258417-project Sep 05 12:36:47.991961 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:36:47.991961 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:36:47.991961 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: 9a61a18900c44bea89647fc9ccdaf110 Sep 05 12:36:47.991961 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-AttachVolumeShelveTestJSON-793258417-project Sep 05 12:36:47.991961 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:36:47.991961 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 could not be found. Sep 05 12:36:47.991961 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': '407e87bb-faeb-4ba6-b6dc-e9b7a3690356'} Sep 05 12:36:47.992947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:36:47.992947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:47.992947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:36:47.992947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:36:47.992947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:36:47.992947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:36:47.992947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:36:47.992947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:36:47.992947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:36:47.992947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:36:47.992947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 could not be found. Sep 05 12:36:47.992947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:47.992947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:47.992947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:47.992947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:47.992947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:47.992947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:47.992947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:36:47.992947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:36:47.992947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:36:47.994653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:36:47.994653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:36:47.994653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:36:47.994653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:36:47.994653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:36:47.994653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:36:47.994653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:36:47.994653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 could not be found. Sep 05 12:36:47.994653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:47.994653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:47.994653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:47.994653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:47.994653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:47.994653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:47.994653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:36:47.994653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:36:47.994653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 could not be found. Sep 05 12:36:47.994653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:47.995889 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-509b5a9e-f9a4-4f84-9e1a-c6fbfffc930d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Returning 404 to user: Instance 407e87bb-faeb-4ba6-b6dc-e9b7a3690356 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:36:47.995889 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-509b5a9e-f9a4-4f84-9e1a-c6fbfffc930d tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356" status: 404 len: 111 microversion: 2.20 time: 0.032259 Sep 05 12:36:47.995889 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 462/944] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:36:47 2022] GET /compute/v2.1/servers/407e87bb-faeb-4ba6-b6dc-e9b7a3690356 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 05 12:36:49.286755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8874aef1-f097-4481-ac99-87876623f9be tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:49.287257 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-8874aef1-f097-4481-ac99-87876623f9be tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:49.294387 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8874aef1-f097-4481-ac99-87876623f9be tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:49.294866 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8874aef1-f097-4481-ac99-87876623f9be tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:49.295325 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8874aef1-f097-4481-ac99-87876623f9be tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:49.296046 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8874aef1-f097-4481-ac99-87876623f9be tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:49.296499 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8874aef1-f097-4481-ac99-87876623f9be tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:49.296928 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8874aef1-f097-4481-ac99-87876623f9be tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:49.310336 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-8874aef1-f097-4481-ac99-87876623f9be tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] HTTP exception thrown: Instance a0105c66-6939-4b6d-b774-c1821012c1f0 could not be found. Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8874aef1-f097-4481-ac99-87876623f9be tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Request method failure captured: Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: DELETE /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 HTTP/1.1 Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFeumSnTBVkpu6EglMHsXvEVreXN-ecouhECu3sHOydWwJQRqKYX1IbEHpcAOyupR0JZoOfJ4jP5Lfc7EWbVrDYx3pQNVWC2NDPZBKY-A_4JgQatZjCmiIQ9G2aOG3eLH761jTySfb7t7bz2LqLlcg7u8hqJHs9MYVXH-i6LHBelxddU Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 094bae935a1e4738b0c51d33c6d89e3a Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-793258417 Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:36:49.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:36:49.319777 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:36:49.319777 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-AttachVolumeShelveTestJSON-793258417 Sep 05 12:36:49.319777 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 094bae935a1e4738b0c51d33c6d89e3a Sep 05 12:36:49.319777 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-793258417 Sep 05 12:36:49.319777 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-AttachVolumeShelveTestJSON-793258417-project Sep 05 12:36:49.319777 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:36:49.319777 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:36:49.319777 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: 9a61a18900c44bea89647fc9ccdaf110 Sep 05 12:36:49.319777 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-AttachVolumeShelveTestJSON-793258417-project Sep 05 12:36:49.319777 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: > Sep 05 12:36:49.319777 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Instance a0105c66-6939-4b6d-b774-c1821012c1f0 could not be found. Sep 05 12:36:49.319777 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': 'a0105c66-6939-4b6d-b774-c1821012c1f0'} Sep 05 12:36:49.320610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:36:49.320610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:49.320610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:36:49.320610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:36:49.320610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:36:49.320610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:36:49.320610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:36:49.320610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:36:49.320610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:36:49.320610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:36:49.320610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0105c66-6939-4b6d-b774-c1821012c1f0 could not be found. Sep 05 12:36:49.320610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:49.320610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:49.320610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:49.320610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:49.320610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:49.320610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:49.320610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:36:49.320610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:36:49.320610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:36:49.322077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:36:49.322077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 12:36:49.322077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 12:36:49.322077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 12:36:49.322077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 12:36:49.322077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:36:49.322077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:36:49.322077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:36:49.322077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:36:49.322077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0105c66-6939-4b6d-b774-c1821012c1f0 could not be found. Sep 05 12:36:49.322077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:49.322077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:49.322077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:49.322077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:49.322077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:49.322077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:49.322077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:36:49.322077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:36:49.322077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0105c66-6939-4b6d-b774-c1821012c1f0 could not be found. Sep 05 12:36:49.322077 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:36:49.323557 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8874aef1-f097-4481-ac99-87876623f9be tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Returning 404 to user: Instance a0105c66-6939-4b6d-b774-c1821012c1f0 could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:36:49.323557 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-8874aef1-f097-4481-ac99-87876623f9be tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 404 len: 111 microversion: 2.20 time: 0.031205 Sep 05 12:36:49.323557 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 483/945] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Sep 5 12:36:49 2022] DELETE /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 05 12:36:49.325267 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-b52b0653-e1eb-494e-8ca6-ea3c3e5329e9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:36:49.325879 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-b52b0653-e1eb-494e-8ca6-ea3c3e5329e9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] [instance: a0105c66-6939-4b6d-b774-c1821012c1f0] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:36:49.333161 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b52b0653-e1eb-494e-8ca6-ea3c3e5329e9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:49.333642 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b52b0653-e1eb-494e-8ca6-ea3c3e5329e9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:49.334077 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b52b0653-e1eb-494e-8ca6-ea3c3e5329e9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:49.334769 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b52b0653-e1eb-494e-8ca6-ea3c3e5329e9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:36:49.335220 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b52b0653-e1eb-494e-8ca6-ea3c3e5329e9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:36:49.335671 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b52b0653-e1eb-494e-8ca6-ea3c3e5329e9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:36:49.349085 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-b52b0653-e1eb-494e-8ca6-ea3c3e5329e9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] HTTP exception thrown: Instance a0105c66-6939-4b6d-b774-c1821012c1f0 could not be found. Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-b52b0653-e1eb-494e-8ca6-ea3c3e5329e9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Request method failure captured: Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 HTTP/1.1 Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFeumSnTBVkpu6EglMHsXvEVreXN-ecouhECu3sHOydWwJQRqKYX1IbEHpcAOyupR0JZoOfJ4jP5Lfc7EWbVrDYx3pQNVWC2NDPZBKY-A_4JgQatZjCmiIQ9G2aOG3eLH761jTySfb7t7bz2LqLlcg7u8hqJHs9MYVXH-i6LHBelxddU Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 094bae935a1e4738b0c51d33c6d89e3a Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-793258417 Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:36:49.350668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:36:49.352410 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_094bae935a1e4738b0c51d33c6d89e3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:36:49.352410 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-AttachVolumeShelveTestJSON-793258417 Sep 05 12:36:49.352410 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 094bae935a1e4738b0c51d33c6d89e3a Sep 05 12:36:49.352410 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-793258417 Sep 05 12:36:49.352410 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-AttachVolumeShelveTestJSON-793258417-project Sep 05 12:36:49.352410 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:36:49.352410 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:36:49.352410 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: 9a61a18900c44bea89647fc9ccdaf110 Sep 05 12:36:49.352410 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-AttachVolumeShelveTestJSON-793258417-project Sep 05 12:36:49.352410 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:36:49.352410 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance a0105c66-6939-4b6d-b774-c1821012c1f0 could not be found. Sep 05 12:36:49.352410 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': 'a0105c66-6939-4b6d-b774-c1821012c1f0'} Sep 05 12:36:49.353505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:36:49.353505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:49.353505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:36:49.353505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:36:49.353505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:36:49.353505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:36:49.353505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:36:49.353505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:36:49.353505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:36:49.353505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:36:49.353505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0105c66-6939-4b6d-b774-c1821012c1f0 could not be found. Sep 05 12:36:49.353505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:49.353505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:49.353505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:49.353505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:49.353505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:49.353505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:49.353505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:36:49.353505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:36:49.353505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:36:49.355049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:36:49.355049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:36:49.355049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:36:49.355049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:36:49.355049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:36:49.355049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:36:49.355049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:36:49.355049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0105c66-6939-4b6d-b774-c1821012c1f0 could not be found. Sep 05 12:36:49.355049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:49.355049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:36:49.355049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:49.355049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:36:49.355049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:36:49.355049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:36:49.355049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:36:49.355049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:36:49.355049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0105c66-6939-4b6d-b774-c1821012c1f0 could not be found. Sep 05 12:36:49.355049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:36:49.356649 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-b52b0653-e1eb-494e-8ca6-ea3c3e5329e9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] Returning 404 to user: Instance a0105c66-6939-4b6d-b774-c1821012c1f0 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:36:49.356649 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-b52b0653-e1eb-494e-8ca6-ea3c3e5329e9 tempest-AttachVolumeShelveTestJSON-793258417 tempest-AttachVolumeShelveTestJSON-793258417-project] 10.222.0.62 "GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0" status: 404 len: 111 microversion: 2.20 time: 0.031092 Sep 05 12:36:49.356649 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 463/946] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Sep 5 12:36:49 2022] GET /compute/v2.1/servers/a0105c66-6939-4b6d-b774-c1821012c1f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 05 12:37:01.366556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:01.513208 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-78ae900c-5210-4c31-b5cc-2c79a153af7c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Action: 'create', calling method: .version_select at 0x7fe712763310>, body: {"keypair": {"name": "tempest-keypair-1075825196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhk5v1LbAptWjrkVOlkfeucE2ecI7JMMXitSgR7t319a9e7GnjrNy1wczLCMDBUjlehCH0iO0uj8JSWZ+Iy8o+LpjjMU9zNPuXJwhsNIuYJ8dnOP4BTJPXUgzaqRNswBw=="}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:37:01.533380 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-78ae900c-5210-4c31-b5cc-2c79a153af7c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Getting quotas for project 7b514c04a13742b1b19d46fec1c40f69. Resources: {'key_pairs'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:37:01.537684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-78ae900c-5210-4c31-b5cc-2c79a153af7c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Getting quotas for user 8bfb013575d540c59121ac8a1613fc0f and project 7b514c04a13742b1b19d46fec1c40f69. Resources: {'key_pairs'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:37:01.679449 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-78ae900c-5210-4c31-b5cc-2c79a153af7c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.318588 Sep 05 12:37:01.680017 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 484/947] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Sep 5 12:37:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:37:04.079894 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-f91a246d-ca95-4fcf-beb4-4bae818045a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1889586521", "imageRef": "7844cf5b-4975-4cb9-a7f8-31cc5e52098a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe3deca4-eb5b-4550-84a3-afb4afe5c540"}], "security_groups": [{"name": "tempest-securitygroup--1870791105"}], "key_name": "tempest-keypair-1075825196", "user_data": "}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:37:04.090977 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=55 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:04.197449 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.network.neutron [None req-f91a246d-ca95-4fcf-beb4-4bae818045a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] validate_networks() for [('fe3deca4-eb5b-4550-84a3-afb4afe5c540', None, None, None, None, None)] {{(pid=121210) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:37:04.659288 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-f91a246d-ca95-4fcf-beb4-4bae818045a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Flavor limits 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:37:04.659829 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-f91a246d-ca95-4fcf-beb4-4bae818045a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Image limits 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:37:04.660505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-f91a246d-ca95-4fcf-beb4-4bae818045a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Flavor pref 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:37:04.661093 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-f91a246d-ca95-4fcf-beb4-4bae818045a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Image pref 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:37:04.661567 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-f91a246d-ca95-4fcf-beb4-4bae818045a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:37:04.670825 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f91a246d-ca95-4fcf-beb4-4bae818045a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:04.671556 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f91a246d-ca95-4fcf-beb4-4bae818045a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:04.672164 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f91a246d-ca95-4fcf-beb4-4bae818045a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:04.672909 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f91a246d-ca95-4fcf-beb4-4bae818045a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:04.673362 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f91a246d-ca95-4fcf-beb4-4bae818045a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:04.673785 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f91a246d-ca95-4fcf-beb4-4bae818045a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:04.691434 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-f91a246d-ca95-4fcf-beb4-4bae818045a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Getting quotas for project 7b514c04a13742b1b19d46fec1c40f69. Resources: {'ram', 'instances', 'cores'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:37:04.695901 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-f91a246d-ca95-4fcf-beb4-4bae818045a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Getting quotas for user 8bfb013575d540c59121ac8a1613fc0f and project 7b514c04a13742b1b19d46fec1c40f69. Resources: {'ram', 'instances', 'cores'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:37:04.708616 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-f91a246d-ca95-4fcf-beb4-4bae818045a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Going to run 1 instances... {{(pid=121210) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:37:04.710978 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-f91a246d-ca95-4fcf-beb4-4bae818045a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7844cf5b-4975-4cb9-a7f8-31cc5e52098a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:37:04.858581 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-f91a246d-ca95-4fcf-beb4-4bae818045a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.780464 Sep 05 12:37:04.858581 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 464/948] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Sep 5 12:37:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:37:04.867817 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e86fb90c-2751-47b9-b15b-e268edd413b3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:04.868462 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e86fb90c-2751-47b9-b15b-e268edd413b3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:04.926541 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e86fb90c-2751-47b9-b15b-e268edd413b3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:04.934425 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e86fb90c-2751-47b9-b15b-e268edd413b3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1238 microversion: 2.1 time: 0.070934 Sep 05 12:37:04.934989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 485/949] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:04 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:05.959370 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-275a0a04-15a3-45b9-a616-fe71ff5eac30 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:05.960071 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-275a0a04-15a3-45b9-a616-fe71ff5eac30 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:05.969201 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-275a0a04-15a3-45b9-a616-fe71ff5eac30 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:05.969695 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-275a0a04-15a3-45b9-a616-fe71ff5eac30 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:05.970124 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-275a0a04-15a3-45b9-a616-fe71ff5eac30 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:05.970825 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-275a0a04-15a3-45b9-a616-fe71ff5eac30 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:05.971446 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-275a0a04-15a3-45b9-a616-fe71ff5eac30 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:05.971903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-275a0a04-15a3-45b9-a616-fe71ff5eac30 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:06.044339 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-275a0a04-15a3-45b9-a616-fe71ff5eac30 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:06.058573 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-275a0a04-15a3-45b9-a616-fe71ff5eac30 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1242 microversion: 2.1 time: 0.104277 Sep 05 12:37:06.064269 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 465/950] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:05 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:07.088760 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3cf3d363-d8bd-4c43-8b29-51f78d5d171d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:07.088760 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-3cf3d363-d8bd-4c43-8b29-51f78d5d171d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:07.092366 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3cf3d363-d8bd-4c43-8b29-51f78d5d171d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:07.092849 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3cf3d363-d8bd-4c43-8b29-51f78d5d171d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:07.093283 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3cf3d363-d8bd-4c43-8b29-51f78d5d171d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:07.094543 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3cf3d363-d8bd-4c43-8b29-51f78d5d171d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:07.094999 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3cf3d363-d8bd-4c43-8b29-51f78d5d171d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:07.095419 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3cf3d363-d8bd-4c43-8b29-51f78d5d171d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:07.162779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3cf3d363-d8bd-4c43-8b29-51f78d5d171d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:07.170817 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3cf3d363-d8bd-4c43-8b29-51f78d5d171d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1290 microversion: 2.1 time: 0.089188 Sep 05 12:37:07.171386 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 486/951] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:07 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:08.198300 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-6651be5d-c8a2-4db3-a625-fc07d92d8e0d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:08.198944 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-6651be5d-c8a2-4db3-a625-fc07d92d8e0d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:08.205412 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6651be5d-c8a2-4db3-a625-fc07d92d8e0d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:08.205890 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6651be5d-c8a2-4db3-a625-fc07d92d8e0d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:08.206319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6651be5d-c8a2-4db3-a625-fc07d92d8e0d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:08.207011 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6651be5d-c8a2-4db3-a625-fc07d92d8e0d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:08.207462 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6651be5d-c8a2-4db3-a625-fc07d92d8e0d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:08.207914 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6651be5d-c8a2-4db3-a625-fc07d92d8e0d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:08.274369 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6651be5d-c8a2-4db3-a625-fc07d92d8e0d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:08.281987 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-6651be5d-c8a2-4db3-a625-fc07d92d8e0d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1290 microversion: 2.1 time: 0.087593 Sep 05 12:37:08.282554 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 466/952] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:08 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1290 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:09.304757 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-169abb65-f71c-4027-b8e5-79a8e8460ca2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:09.305316 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-169abb65-f71c-4027-b8e5-79a8e8460ca2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:09.312013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-169abb65-f71c-4027-b8e5-79a8e8460ca2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:09.312498 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-169abb65-f71c-4027-b8e5-79a8e8460ca2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:09.313439 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-169abb65-f71c-4027-b8e5-79a8e8460ca2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:09.314134 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-169abb65-f71c-4027-b8e5-79a8e8460ca2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:09.314591 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-169abb65-f71c-4027-b8e5-79a8e8460ca2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:09.315016 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-169abb65-f71c-4027-b8e5-79a8e8460ca2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:09.386502 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-169abb65-f71c-4027-b8e5-79a8e8460ca2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:09.395684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-169abb65-f71c-4027-b8e5-79a8e8460ca2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1290 microversion: 2.1 time: 0.094812 Sep 05 12:37:09.396250 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 487/953] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:09 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1290 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:10.421614 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-74f3a5c1-b0c9-4dcf-8254-cc02f54ed93c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:10.423888 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-74f3a5c1-b0c9-4dcf-8254-cc02f54ed93c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:10.430948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-74f3a5c1-b0c9-4dcf-8254-cc02f54ed93c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:10.431817 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-74f3a5c1-b0c9-4dcf-8254-cc02f54ed93c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:10.432327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-74f3a5c1-b0c9-4dcf-8254-cc02f54ed93c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:10.433388 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-74f3a5c1-b0c9-4dcf-8254-cc02f54ed93c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:10.434067 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-74f3a5c1-b0c9-4dcf-8254-cc02f54ed93c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:10.434886 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-74f3a5c1-b0c9-4dcf-8254-cc02f54ed93c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:10.498704 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-74f3a5c1-b0c9-4dcf-8254-cc02f54ed93c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:10.507821 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-74f3a5c1-b0c9-4dcf-8254-cc02f54ed93c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1308 microversion: 2.1 time: 0.089811 Sep 05 12:37:10.508524 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 467/954] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:10 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1308 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:11.428894 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ad6a3213-9762-43a1-a57c-f4b8b903b594 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1894341161", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-384624755", "security_groups": [{"name": "tempest-secgroup-smoke-1211654380"}], "block_device_mapping_v2": [{"uuid": "7edd89ee-2f33-430a-a915-fd0143fbb6e7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "38f5b205-d0f7-419a-8f07-cc61071fe0f8"}]}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:37:11.530938 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-2d22256a-cb38-4636-bbfe-efb6c8178eb4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:11.531841 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-2d22256a-cb38-4636-bbfe-efb6c8178eb4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:11.538748 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2d22256a-cb38-4636-bbfe-efb6c8178eb4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:11.539300 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2d22256a-cb38-4636-bbfe-efb6c8178eb4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:11.539765 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2d22256a-cb38-4636-bbfe-efb6c8178eb4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:11.540975 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2d22256a-cb38-4636-bbfe-efb6c8178eb4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:11.541503 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2d22256a-cb38-4636-bbfe-efb6c8178eb4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:11.541995 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2d22256a-cb38-4636-bbfe-efb6c8178eb4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:11.587480 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.network.neutron [None req-ad6a3213-9762-43a1-a57c-f4b8b903b594 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] validate_networks() for [('38f5b205-d0f7-419a-8f07-cc61071fe0f8', None, None, None, None, None)] {{(pid=121211) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:37:11.686473 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-2d22256a-cb38-4636-bbfe-efb6c8178eb4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:11.696416 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-2d22256a-cb38-4636-bbfe-efb6c8178eb4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1364 microversion: 2.1 time: 0.169872 Sep 05 12:37:11.697004 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 468/955] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:11 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:37:12.208529 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-ad6a3213-9762-43a1-a57c-f4b8b903b594 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Flavor limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:37:12.208955 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-ad6a3213-9762-43a1-a57c-f4b8b903b594 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Image limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:37:12.209445 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-ad6a3213-9762-43a1-a57c-f4b8b903b594 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Flavor pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:37:12.209836 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-ad6a3213-9762-43a1-a57c-f4b8b903b594 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Image pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:37:12.210316 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-ad6a3213-9762-43a1-a57c-f4b8b903b594 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:37:12.221138 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ad6a3213-9762-43a1-a57c-f4b8b903b594 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:12.221619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ad6a3213-9762-43a1-a57c-f4b8b903b594 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:12.222132 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ad6a3213-9762-43a1-a57c-f4b8b903b594 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:12.222920 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ad6a3213-9762-43a1-a57c-f4b8b903b594 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:12.223371 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ad6a3213-9762-43a1-a57c-f4b8b903b594 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:12.223829 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ad6a3213-9762-43a1-a57c-f4b8b903b594 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:12.241899 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-ad6a3213-9762-43a1-a57c-f4b8b903b594 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Getting quotas for project 4377cb4a93524abd99acb6ebe07fd1d6. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:37:12.246130 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-ad6a3213-9762-43a1-a57c-f4b8b903b594 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Getting quotas for user e7a29212dfae4a93beea7d11085cde63 and project 4377cb4a93524abd99acb6ebe07fd1d6. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:37:12.296523 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-cc7466c6-8896-43e2-a29b-7d763c250bce req-b66f602c-781d-474b-bc03-fec93bd857dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a5d85b-7178-468f-8bc1-f4a6ccef9d14", "tag": "718e1a6d-4d8c-4ebf-849a-b9dc2ea2c4d1"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:37:12.308051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ad6a3213-9762-43a1-a57c-f4b8b903b594 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Going to run 1 instances... {{(pid=121211) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:37:12.308987 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-cc7466c6-8896-43e2-a29b-7d763c250bce req-b66f602c-781d-474b-bc03-fec93bd857dd service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:12.309464 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-cc7466c6-8896-43e2-a29b-7d763c250bce req-b66f602c-781d-474b-bc03-fec93bd857dd service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:12.310133 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-cc7466c6-8896-43e2-a29b-7d763c250bce req-b66f602c-781d-474b-bc03-fec93bd857dd service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:12.310274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ad6a3213-9762-43a1-a57c-f4b8b903b594 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7edd89ee-2f33-430a-a915-fd0143fbb6e7',volume_size=None,volume_type=None)] {{(pid=121211) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:37:12.323251 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-cc7466c6-8896-43e2-a29b-7d763c250bce req-b66f602c-781d-474b-bc03-fec93bd857dd service nova] Creating event network-changed:718e1a6d-4d8c-4ebf-849a-b9dc2ea2c4d1 for instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 on hv-cinder-80135 Sep 05 12:37:12.329234 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-cc7466c6-8896-43e2-a29b-7d763c250bce req-b66f602c-781d-474b-bc03-fec93bd857dd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043794 Sep 05 12:37:12.329899 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 469/956] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:37:12.720801 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-c79dbab1-43df-457a-a82e-c9f1a97bf52e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:12.721467 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-c79dbab1-43df-457a-a82e-c9f1a97bf52e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:12.727928 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c79dbab1-43df-457a-a82e-c9f1a97bf52e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:12.728413 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c79dbab1-43df-457a-a82e-c9f1a97bf52e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:12.728838 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c79dbab1-43df-457a-a82e-c9f1a97bf52e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:12.729531 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c79dbab1-43df-457a-a82e-c9f1a97bf52e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:12.730052 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c79dbab1-43df-457a-a82e-c9f1a97bf52e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:12.730462 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c79dbab1-43df-457a-a82e-c9f1a97bf52e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:12.804842 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ad6a3213-9762-43a1-a57c-f4b8b903b594 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.380012 Sep 05 12:37:12.805834 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 488/957] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Sep 5 12:37:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:37:12.819206 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-731c90bf-85c0-4ff2-918b-73e590ceff91 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:12.820115 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-731c90bf-85c0-4ff2-918b-73e590ceff91 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:12.900277 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c79dbab1-43df-457a-a82e-c9f1a97bf52e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:12.917008 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-c79dbab1-43df-457a-a82e-c9f1a97bf52e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1364 microversion: 2.1 time: 0.200292 Sep 05 12:37:12.918396 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 470/958] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:12 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:37:12.939817 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-731c90bf-85c0-4ff2-918b-73e590ceff91 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:12.960541 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-731c90bf-85c0-4ff2-918b-73e590ceff91 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1094 microversion: 2.1 time: 0.144663 Sep 05 12:37:12.961574 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 489/959] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:12 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1094 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:13.946391 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-2ada6395-bf99-4fd6-83d5-9e79af66ca42 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:13.947005 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-2ada6395-bf99-4fd6-83d5-9e79af66ca42 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:13.952959 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2ada6395-bf99-4fd6-83d5-9e79af66ca42 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:13.953997 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2ada6395-bf99-4fd6-83d5-9e79af66ca42 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:13.954447 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2ada6395-bf99-4fd6-83d5-9e79af66ca42 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:13.955139 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2ada6395-bf99-4fd6-83d5-9e79af66ca42 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:13.955633 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2ada6395-bf99-4fd6-83d5-9e79af66ca42 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:13.956069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2ada6395-bf99-4fd6-83d5-9e79af66ca42 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:13.998045 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1d0c5cad-1a52-4758-b42a-a00eb38e8879 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:13.998045 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1d0c5cad-1a52-4758-b42a-a00eb38e8879 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:14.005356 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1d0c5cad-1a52-4758-b42a-a00eb38e8879 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:14.005891 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1d0c5cad-1a52-4758-b42a-a00eb38e8879 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:14.006474 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1d0c5cad-1a52-4758-b42a-a00eb38e8879 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:14.007187 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1d0c5cad-1a52-4758-b42a-a00eb38e8879 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:14.007676 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1d0c5cad-1a52-4758-b42a-a00eb38e8879 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:14.008106 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1d0c5cad-1a52-4758-b42a-a00eb38e8879 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:14.104983 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-2ada6395-bf99-4fd6-83d5-9e79af66ca42 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:14.115704 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-2ada6395-bf99-4fd6-83d5-9e79af66ca42 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1364 microversion: 2.1 time: 0.173092 Sep 05 12:37:14.116668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 471/960] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:13 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:14.141599 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1d0c5cad-1a52-4758-b42a-a00eb38e8879 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:14.149660 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1d0c5cad-1a52-4758-b42a-a00eb38e8879 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1144 microversion: 2.1 time: 0.157393 Sep 05 12:37:14.150245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 490/961] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:13 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1144 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:37:15.145176 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-31fc70b5-d611-45ca-8224-495b23ca9080 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:15.145781 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-31fc70b5-d611-45ca-8224-495b23ca9080 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:15.148089 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=2 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:15.148783 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=6 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:15.154522 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-31fc70b5-d611-45ca-8224-495b23ca9080 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:15.158707 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-31fc70b5-d611-45ca-8224-495b23ca9080 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:15.158707 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-31fc70b5-d611-45ca-8224-495b23ca9080 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:15.158707 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-31fc70b5-d611-45ca-8224-495b23ca9080 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:15.158707 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-31fc70b5-d611-45ca-8224-495b23ca9080 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:15.159130 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-31fc70b5-d611-45ca-8224-495b23ca9080 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:15.173444 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7f7bbab4-120c-47b4-ab65-eaedf789b6f5 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:15.174075 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-7f7bbab4-120c-47b4-ab65-eaedf789b6f5 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:15.181024 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7f7bbab4-120c-47b4-ab65-eaedf789b6f5 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:15.181522 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7f7bbab4-120c-47b4-ab65-eaedf789b6f5 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:15.182082 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7f7bbab4-120c-47b4-ab65-eaedf789b6f5 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:15.183004 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7f7bbab4-120c-47b4-ab65-eaedf789b6f5 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:15.183472 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7f7bbab4-120c-47b4-ab65-eaedf789b6f5 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:15.183931 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7f7bbab4-120c-47b4-ab65-eaedf789b6f5 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:15.253446 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-7f7bbab4-120c-47b4-ab65-eaedf789b6f5 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:15.262164 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-7f7bbab4-120c-47b4-ab65-eaedf789b6f5 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1192 microversion: 2.1 time: 0.093218 Sep 05 12:37:15.263108 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 491/962] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:15 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1192 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:37:15.308019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-31fc70b5-d611-45ca-8224-495b23ca9080 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:15.315870 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-31fc70b5-d611-45ca-8224-495b23ca9080 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1364 microversion: 2.1 time: 0.174789 Sep 05 12:37:15.316461 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 472/963] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:15 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:16.287103 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1a96714e-cbcf-4df1-a1a9-08b2c1f2f5ea tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:16.287736 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1a96714e-cbcf-4df1-a1a9-08b2c1f2f5ea tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:16.294223 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1a96714e-cbcf-4df1-a1a9-08b2c1f2f5ea tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:16.294653 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1a96714e-cbcf-4df1-a1a9-08b2c1f2f5ea tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:16.295079 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1a96714e-cbcf-4df1-a1a9-08b2c1f2f5ea tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:16.295803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1a96714e-cbcf-4df1-a1a9-08b2c1f2f5ea tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:16.296253 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1a96714e-cbcf-4df1-a1a9-08b2c1f2f5ea tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:16.296810 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1a96714e-cbcf-4df1-a1a9-08b2c1f2f5ea tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:16.338414 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-015b1d18-61cb-4f76-aa3e-e8f37d8b0e15 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:16.339120 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-015b1d18-61cb-4f76-aa3e-e8f37d8b0e15 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:16.348315 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-015b1d18-61cb-4f76-aa3e-e8f37d8b0e15 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:16.348315 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-015b1d18-61cb-4f76-aa3e-e8f37d8b0e15 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:16.348315 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-015b1d18-61cb-4f76-aa3e-e8f37d8b0e15 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:16.348834 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-015b1d18-61cb-4f76-aa3e-e8f37d8b0e15 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:16.349302 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-015b1d18-61cb-4f76-aa3e-e8f37d8b0e15 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:16.349765 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-015b1d18-61cb-4f76-aa3e-e8f37d8b0e15 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:16.499660 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-015b1d18-61cb-4f76-aa3e-e8f37d8b0e15 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:16.509959 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-015b1d18-61cb-4f76-aa3e-e8f37d8b0e15 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1364 microversion: 2.1 time: 0.175313 Sep 05 12:37:16.511007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 473/964] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:16 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:37:16.548124 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1a96714e-cbcf-4df1-a1a9-08b2c1f2f5ea tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:16.556289 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1a96714e-cbcf-4df1-a1a9-08b2c1f2f5ea tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1278 microversion: 2.1 time: 0.272931 Sep 05 12:37:16.562089 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 492/965] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:16 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1278 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:17.430846 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-e920b64b-f3b9-42df-a00c-d15ca3766f27 req-4db9d43a-e960-4442-8ca4-f3a01747369b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a5d85b-7178-468f-8bc1-f4a6ccef9d14", "name": "network-vif-plugged", "status": "completed", "tag": "718e1a6d-4d8c-4ebf-849a-b9dc2ea2c4d1"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:37:17.445375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-e920b64b-f3b9-42df-a00c-d15ca3766f27 req-4db9d43a-e960-4442-8ca4-f3a01747369b service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:17.445923 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-e920b64b-f3b9-42df-a00c-d15ca3766f27 req-4db9d43a-e960-4442-8ca4-f3a01747369b service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:17.446631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-e920b64b-f3b9-42df-a00c-d15ca3766f27 req-4db9d43a-e960-4442-8ca4-f3a01747369b service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:17.460210 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-e920b64b-f3b9-42df-a00c-d15ca3766f27 req-4db9d43a-e960-4442-8ca4-f3a01747369b service nova] Creating event network-vif-plugged:718e1a6d-4d8c-4ebf-849a-b9dc2ea2c4d1 for instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 on hv-cinder-80135 Sep 05 12:37:17.465810 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-e920b64b-f3b9-42df-a00c-d15ca3766f27 req-4db9d43a-e960-4442-8ca4-f3a01747369b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040211 Sep 05 12:37:17.466746 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 474/966] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:37:17.537704 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-5abec90c-7881-447f-8f64-12ea7d261fb1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:17.538361 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-5abec90c-7881-447f-8f64-12ea7d261fb1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:17.550398 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5abec90c-7881-447f-8f64-12ea7d261fb1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:17.552036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5abec90c-7881-447f-8f64-12ea7d261fb1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:17.553678 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5abec90c-7881-447f-8f64-12ea7d261fb1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:17.555629 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5abec90c-7881-447f-8f64-12ea7d261fb1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:17.560266 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5abec90c-7881-447f-8f64-12ea7d261fb1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:17.560266 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-5abec90c-7881-447f-8f64-12ea7d261fb1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:17.581729 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-5806766f-2010-47ef-898f-20721c6231aa tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:17.582452 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-5806766f-2010-47ef-898f-20721c6231aa tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:17.591418 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5806766f-2010-47ef-898f-20721c6231aa tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:17.591944 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5806766f-2010-47ef-898f-20721c6231aa tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:17.592376 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5806766f-2010-47ef-898f-20721c6231aa tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:17.593089 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5806766f-2010-47ef-898f-20721c6231aa tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:17.593602 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5806766f-2010-47ef-898f-20721c6231aa tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:17.594244 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5806766f-2010-47ef-898f-20721c6231aa tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:17.736419 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-5806766f-2010-47ef-898f-20721c6231aa tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:17.744288 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-5806766f-2010-47ef-898f-20721c6231aa tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1266 microversion: 2.1 time: 0.167594 Sep 05 12:37:17.745119 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 475/967] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:17 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:37:17.765390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-5abec90c-7881-447f-8f64-12ea7d261fb1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:17.774546 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-5abec90c-7881-447f-8f64-12ea7d261fb1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1364 microversion: 2.1 time: 0.242408 Sep 05 12:37:17.775086 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 493/968] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:17 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:37:17.876251 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-81c4061b-b823-49cf-a413-513530f5f973 req-9751ec67-20c1-481c-847c-bd079ed87e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d43048-46ef-4843-b1ba-6105a322c05f", "tag": "6b29555c-21f4-47bd-b77b-4b65005e7159"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:37:17.886976 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-81c4061b-b823-49cf-a413-513530f5f973 req-9751ec67-20c1-481c-847c-bd079ed87e37 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:17.887808 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-81c4061b-b823-49cf-a413-513530f5f973 req-9751ec67-20c1-481c-847c-bd079ed87e37 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:17.888948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-81c4061b-b823-49cf-a413-513530f5f973 req-9751ec67-20c1-481c-847c-bd079ed87e37 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:17.902362 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-81c4061b-b823-49cf-a413-513530f5f973 req-9751ec67-20c1-481c-847c-bd079ed87e37 service nova] Creating event network-changed:6b29555c-21f4-47bd-b77b-4b65005e7159 for instance 26d43048-46ef-4843-b1ba-6105a322c05f on hv-cinder-80135 Sep 05 12:37:17.907715 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-81c4061b-b823-49cf-a413-513530f5f973 req-9751ec67-20c1-481c-847c-bd079ed87e37 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034658 Sep 05 12:37:17.908470 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 476/969] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:37:18.767873 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-fe1ad5ac-d3cb-4517-a9cf-4a018b98b306 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:18.768516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-fe1ad5ac-d3cb-4517-a9cf-4a018b98b306 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:18.774880 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fe1ad5ac-d3cb-4517-a9cf-4a018b98b306 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:18.775365 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fe1ad5ac-d3cb-4517-a9cf-4a018b98b306 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:18.775846 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fe1ad5ac-d3cb-4517-a9cf-4a018b98b306 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:18.776617 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fe1ad5ac-d3cb-4517-a9cf-4a018b98b306 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:18.777030 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fe1ad5ac-d3cb-4517-a9cf-4a018b98b306 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:18.777456 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fe1ad5ac-d3cb-4517-a9cf-4a018b98b306 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:18.809172 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-42ad9a78-5f73-415d-a813-2415a5df9333 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:18.810170 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-42ad9a78-5f73-415d-a813-2415a5df9333 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:18.817789 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-42ad9a78-5f73-415d-a813-2415a5df9333 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:18.818380 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-42ad9a78-5f73-415d-a813-2415a5df9333 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:18.818884 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-42ad9a78-5f73-415d-a813-2415a5df9333 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:18.819689 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-42ad9a78-5f73-415d-a813-2415a5df9333 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:18.820272 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-42ad9a78-5f73-415d-a813-2415a5df9333 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:18.820931 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-42ad9a78-5f73-415d-a813-2415a5df9333 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:18.966193 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-42ad9a78-5f73-415d-a813-2415a5df9333 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:18.974326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-42ad9a78-5f73-415d-a813-2415a5df9333 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1364 microversion: 2.1 time: 0.169773 Sep 05 12:37:18.974910 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 477/970] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:18 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:18.988599 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-fe1ad5ac-d3cb-4517-a9cf-4a018b98b306 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:18.998107 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-fe1ad5ac-d3cb-4517-a9cf-4a018b98b306 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1266 microversion: 2.1 time: 0.234119 Sep 05 12:37:18.998690 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 494/971] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:18 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:19.998372 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-607f4911-38af-40c9-8f99-167824517e4b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:19.998930 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-607f4911-38af-40c9-8f99-167824517e4b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:20.005492 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-607f4911-38af-40c9-8f99-167824517e4b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:20.005979 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-607f4911-38af-40c9-8f99-167824517e4b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:20.006416 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-607f4911-38af-40c9-8f99-167824517e4b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:20.007110 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-607f4911-38af-40c9-8f99-167824517e4b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:20.007583 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-607f4911-38af-40c9-8f99-167824517e4b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:20.008013 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-607f4911-38af-40c9-8f99-167824517e4b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:20.021670 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d3eb4a21-c6a2-4d01-a508-02822e467ce9 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:20.022461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d3eb4a21-c6a2-4d01-a508-02822e467ce9 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:20.039134 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d3eb4a21-c6a2-4d01-a508-02822e467ce9 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:20.040320 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d3eb4a21-c6a2-4d01-a508-02822e467ce9 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:20.041085 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d3eb4a21-c6a2-4d01-a508-02822e467ce9 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:20.042057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d3eb4a21-c6a2-4d01-a508-02822e467ce9 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:20.042758 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d3eb4a21-c6a2-4d01-a508-02822e467ce9 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:20.043437 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d3eb4a21-c6a2-4d01-a508-02822e467ce9 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:20.171881 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-607f4911-38af-40c9-8f99-167824517e4b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:20.180887 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-607f4911-38af-40c9-8f99-167824517e4b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1550 microversion: 2.1 time: 0.186882 Sep 05 12:37:20.181471 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 478/972] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:19 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1550 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:20.204146 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7dbc853f-b5c2-4586-9ab2-22b427bad0f2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:20.204648 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-7dbc853f-b5c2-4586-9ab2-22b427bad0f2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:20.207568 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d3eb4a21-c6a2-4d01-a508-02822e467ce9 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:20.210988 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7dbc853f-b5c2-4586-9ab2-22b427bad0f2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:20.211510 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7dbc853f-b5c2-4586-9ab2-22b427bad0f2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:20.211974 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7dbc853f-b5c2-4586-9ab2-22b427bad0f2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:20.212680 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7dbc853f-b5c2-4586-9ab2-22b427bad0f2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:20.213131 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7dbc853f-b5c2-4586-9ab2-22b427bad0f2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:20.213548 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7dbc853f-b5c2-4586-9ab2-22b427bad0f2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:20.214322 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d3eb4a21-c6a2-4d01-a508-02822e467ce9 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1266 microversion: 2.1 time: 0.196841 Sep 05 12:37:20.216523 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 495/973] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:20 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:20.295725 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-7dbc853f-b5c2-4586-9ab2-22b427bad0f2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095893 Sep 05 12:37:20.296391 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 479/974] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Sep 5 12:37:20 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:37:21.238726 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f18bdc6e-60d3-482e-9533-0d9c5e9ea849 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:21.239356 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f18bdc6e-60d3-482e-9533-0d9c5e9ea849 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:21.246269 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f18bdc6e-60d3-482e-9533-0d9c5e9ea849 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:21.246762 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f18bdc6e-60d3-482e-9533-0d9c5e9ea849 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:21.247209 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f18bdc6e-60d3-482e-9533-0d9c5e9ea849 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:21.247949 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f18bdc6e-60d3-482e-9533-0d9c5e9ea849 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:21.248412 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f18bdc6e-60d3-482e-9533-0d9c5e9ea849 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:21.248840 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f18bdc6e-60d3-482e-9533-0d9c5e9ea849 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:21.427308 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-4ecfe129-0d22-4ef1-bcef-a501ff80b545 req-9e890510-375d-431b-ac41-6347e4f362dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a5d85b-7178-468f-8bc1-f4a6ccef9d14", "tag": "718e1a6d-4d8c-4ebf-849a-b9dc2ea2c4d1"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:37:21.438969 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-4ecfe129-0d22-4ef1-bcef-a501ff80b545 req-9e890510-375d-431b-ac41-6347e4f362dc service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:21.439452 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-4ecfe129-0d22-4ef1-bcef-a501ff80b545 req-9e890510-375d-431b-ac41-6347e4f362dc service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:21.442566 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f18bdc6e-60d3-482e-9533-0d9c5e9ea849 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:21.446353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-4ecfe129-0d22-4ef1-bcef-a501ff80b545 req-9e890510-375d-431b-ac41-6347e4f362dc service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:21.452585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f18bdc6e-60d3-482e-9533-0d9c5e9ea849 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1266 microversion: 2.1 time: 0.218024 Sep 05 12:37:21.463066 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-4ecfe129-0d22-4ef1-bcef-a501ff80b545 req-9e890510-375d-431b-ac41-6347e4f362dc service nova] Creating event network-changed:718e1a6d-4d8c-4ebf-849a-b9dc2ea2c4d1 for instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 on hv-cinder-80135 Sep 05 12:37:21.466524 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 496/975] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:21 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:21.468879 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-4ecfe129-0d22-4ef1-bcef-a501ff80b545 req-9e890510-375d-431b-ac41-6347e4f362dc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045264 Sep 05 12:37:21.469657 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 480/976] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:37:22.473886 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=2 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:22.478616 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c12a9f1f-6f34-4fcf-8524-0513bd8ca6ec tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:22.479234 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-c12a9f1f-6f34-4fcf-8524-0513bd8ca6ec tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:22.485472 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c12a9f1f-6f34-4fcf-8524-0513bd8ca6ec tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:22.485970 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c12a9f1f-6f34-4fcf-8524-0513bd8ca6ec tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:22.486404 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c12a9f1f-6f34-4fcf-8524-0513bd8ca6ec tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:22.487113 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c12a9f1f-6f34-4fcf-8524-0513bd8ca6ec tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:22.487587 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c12a9f1f-6f34-4fcf-8524-0513bd8ca6ec tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:22.488015 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c12a9f1f-6f34-4fcf-8524-0513bd8ca6ec tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:22.627979 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c12a9f1f-6f34-4fcf-8524-0513bd8ca6ec tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:22.641791 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-c12a9f1f-6f34-4fcf-8524-0513bd8ca6ec tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1266 microversion: 2.1 time: 0.168062 Sep 05 12:37:22.642394 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 497/977] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:22 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:23.665923 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-cdb7dcd0-ae93-46e0-b73f-5bc9b13a3b95 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:23.666623 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-cdb7dcd0-ae93-46e0-b73f-5bc9b13a3b95 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:23.673538 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cdb7dcd0-ae93-46e0-b73f-5bc9b13a3b95 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:23.674012 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cdb7dcd0-ae93-46e0-b73f-5bc9b13a3b95 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:23.674435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cdb7dcd0-ae93-46e0-b73f-5bc9b13a3b95 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:23.675123 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cdb7dcd0-ae93-46e0-b73f-5bc9b13a3b95 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:23.675615 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cdb7dcd0-ae93-46e0-b73f-5bc9b13a3b95 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:23.676041 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-cdb7dcd0-ae93-46e0-b73f-5bc9b13a3b95 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:23.809587 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-cdb7dcd0-ae93-46e0-b73f-5bc9b13a3b95 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:23.817536 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-cdb7dcd0-ae93-46e0-b73f-5bc9b13a3b95 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1266 microversion: 2.1 time: 0.156227 Sep 05 12:37:23.818288 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 481/978] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:23 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:24.840920 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-aa386fb3-fdc6-4865-a2da-b9004e331260 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:24.841519 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-aa386fb3-fdc6-4865-a2da-b9004e331260 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:24.843350 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=14 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:24.849356 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa386fb3-fdc6-4865-a2da-b9004e331260 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:24.849836 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa386fb3-fdc6-4865-a2da-b9004e331260 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:24.850279 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa386fb3-fdc6-4865-a2da-b9004e331260 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:24.850974 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa386fb3-fdc6-4865-a2da-b9004e331260 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:24.851486 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa386fb3-fdc6-4865-a2da-b9004e331260 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:24.851939 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa386fb3-fdc6-4865-a2da-b9004e331260 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:24.992886 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-aa386fb3-fdc6-4865-a2da-b9004e331260 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:25.001542 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-aa386fb3-fdc6-4865-a2da-b9004e331260 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1266 microversion: 2.1 time: 0.164750 Sep 05 12:37:25.002122 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 498/979] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:24 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:26.029138 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-3f56d1d1-bed7-4201-a37c-9fd50b0a608d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:26.029818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-3f56d1d1-bed7-4201-a37c-9fd50b0a608d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:26.036710 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3f56d1d1-bed7-4201-a37c-9fd50b0a608d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:26.037203 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3f56d1d1-bed7-4201-a37c-9fd50b0a608d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:26.037668 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3f56d1d1-bed7-4201-a37c-9fd50b0a608d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:26.038375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3f56d1d1-bed7-4201-a37c-9fd50b0a608d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:26.038833 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3f56d1d1-bed7-4201-a37c-9fd50b0a608d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:26.039286 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3f56d1d1-bed7-4201-a37c-9fd50b0a608d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:26.185758 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-3f56d1d1-bed7-4201-a37c-9fd50b0a608d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:26.197557 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-3f56d1d1-bed7-4201-a37c-9fd50b0a608d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1266 microversion: 2.1 time: 0.172256 Sep 05 12:37:26.198115 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 482/980] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:26 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:27.221405 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-dde735b3-9750-494d-9383-d1a2c70c6871 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:27.222072 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-dde735b3-9750-494d-9383-d1a2c70c6871 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:27.228665 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-dde735b3-9750-494d-9383-d1a2c70c6871 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:27.229444 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-dde735b3-9750-494d-9383-d1a2c70c6871 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:27.229876 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-dde735b3-9750-494d-9383-d1a2c70c6871 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:27.230771 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-dde735b3-9750-494d-9383-d1a2c70c6871 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:27.231411 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-dde735b3-9750-494d-9383-d1a2c70c6871 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:27.232177 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-dde735b3-9750-494d-9383-d1a2c70c6871 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:27.395695 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-dde735b3-9750-494d-9383-d1a2c70c6871 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:27.405443 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-dde735b3-9750-494d-9383-d1a2c70c6871 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1266 microversion: 2.1 time: 0.188247 Sep 05 12:37:27.408533 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 499/981] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:27 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:28.431732 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ea3f7119-beb8-4d9c-932c-7b91c60dd900 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:28.432775 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-ea3f7119-beb8-4d9c-932c-7b91c60dd900 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:28.442941 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ea3f7119-beb8-4d9c-932c-7b91c60dd900 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:28.444050 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ea3f7119-beb8-4d9c-932c-7b91c60dd900 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:28.444807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ea3f7119-beb8-4d9c-932c-7b91c60dd900 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:28.446025 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ea3f7119-beb8-4d9c-932c-7b91c60dd900 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:28.446823 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ea3f7119-beb8-4d9c-932c-7b91c60dd900 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:28.447557 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ea3f7119-beb8-4d9c-932c-7b91c60dd900 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:28.615144 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-ea3f7119-beb8-4d9c-932c-7b91c60dd900 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:28.624134 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-ea3f7119-beb8-4d9c-932c-7b91c60dd900 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1266 microversion: 2.1 time: 0.198855 Sep 05 12:37:28.624902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 483/982] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:28 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:29.649172 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-876d6f6b-0338-42f7-a3bb-15b74f198955 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:29.649869 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-876d6f6b-0338-42f7-a3bb-15b74f198955 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:29.657586 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-876d6f6b-0338-42f7-a3bb-15b74f198955 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:29.658067 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-876d6f6b-0338-42f7-a3bb-15b74f198955 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:29.658500 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-876d6f6b-0338-42f7-a3bb-15b74f198955 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:29.659222 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-876d6f6b-0338-42f7-a3bb-15b74f198955 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:29.659704 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-876d6f6b-0338-42f7-a3bb-15b74f198955 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:29.660132 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-876d6f6b-0338-42f7-a3bb-15b74f198955 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:29.843635 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-876d6f6b-0338-42f7-a3bb-15b74f198955 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:29.864961 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-876d6f6b-0338-42f7-a3bb-15b74f198955 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1266 microversion: 2.1 time: 0.220425 Sep 05 12:37:29.865887 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 500/983] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:29 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:30.897434 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-41f075f6-a1be-4899-bed2-523377adb296 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:30.898055 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-41f075f6-a1be-4899-bed2-523377adb296 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:30.904623 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-41f075f6-a1be-4899-bed2-523377adb296 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:30.905113 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-41f075f6-a1be-4899-bed2-523377adb296 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:30.905549 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-41f075f6-a1be-4899-bed2-523377adb296 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:30.906250 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-41f075f6-a1be-4899-bed2-523377adb296 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:30.906712 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-41f075f6-a1be-4899-bed2-523377adb296 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:30.907142 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-41f075f6-a1be-4899-bed2-523377adb296 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:30.911461 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=100 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:31.051092 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-41f075f6-a1be-4899-bed2-523377adb296 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:31.061072 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-41f075f6-a1be-4899-bed2-523377adb296 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1266 microversion: 2.1 time: 0.167505 Sep 05 12:37:31.061713 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 484/984] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:30 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:31.355444 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-bb38cc0d-5d4d-4742-9d1a-2cb143e23273 req-c597d5c5-61c7-487b-bb03-49f2d44460b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d43048-46ef-4843-b1ba-6105a322c05f", "name": "network-vif-plugged", "status": "completed", "tag": "6b29555c-21f4-47bd-b77b-4b65005e7159"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:37:31.369101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-bb38cc0d-5d4d-4742-9d1a-2cb143e23273 req-c597d5c5-61c7-487b-bb03-49f2d44460b6 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:31.369579 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-bb38cc0d-5d4d-4742-9d1a-2cb143e23273 req-c597d5c5-61c7-487b-bb03-49f2d44460b6 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:31.370007 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-bb38cc0d-5d4d-4742-9d1a-2cb143e23273 req-c597d5c5-61c7-487b-bb03-49f2d44460b6 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:31.381778 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-bb38cc0d-5d4d-4742-9d1a-2cb143e23273 req-c597d5c5-61c7-487b-bb03-49f2d44460b6 service nova] Creating event network-vif-plugged:6b29555c-21f4-47bd-b77b-4b65005e7159 for instance 26d43048-46ef-4843-b1ba-6105a322c05f on hv-cinder-80135 Sep 05 12:37:31.386846 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-bb38cc0d-5d4d-4742-9d1a-2cb143e23273 req-c597d5c5-61c7-487b-bb03-49f2d44460b6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037253 Sep 05 12:37:31.387440 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 501/985] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:37:32.085268 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-fb31ebc1-3848-4cc6-b5d4-4e096c97a29d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:32.085904 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-fb31ebc1-3848-4cc6-b5d4-4e096c97a29d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:32.092980 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fb31ebc1-3848-4cc6-b5d4-4e096c97a29d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:32.095486 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fb31ebc1-3848-4cc6-b5d4-4e096c97a29d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:32.095486 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fb31ebc1-3848-4cc6-b5d4-4e096c97a29d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:32.095486 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fb31ebc1-3848-4cc6-b5d4-4e096c97a29d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:32.095859 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fb31ebc1-3848-4cc6-b5d4-4e096c97a29d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:32.096188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-fb31ebc1-3848-4cc6-b5d4-4e096c97a29d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:32.244784 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-fb31ebc1-3848-4cc6-b5d4-4e096c97a29d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:32.253038 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-fb31ebc1-3848-4cc6-b5d4-4e096c97a29d tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1266 microversion: 2.1 time: 0.171767 Sep 05 12:37:32.253616 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 485/986] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:32 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:37:33.277783 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f96821fe-232e-454e-a171-4e1431564cb3 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:33.278489 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f96821fe-232e-454e-a171-4e1431564cb3 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:33.280780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:33.286161 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f96821fe-232e-454e-a171-4e1431564cb3 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:33.287779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f96821fe-232e-454e-a171-4e1431564cb3 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:33.287779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f96821fe-232e-454e-a171-4e1431564cb3 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:33.288000 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f96821fe-232e-454e-a171-4e1431564cb3 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:33.288317 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f96821fe-232e-454e-a171-4e1431564cb3 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:33.288761 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f96821fe-232e-454e-a171-4e1431564cb3 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:33.293550 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=83 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:33.439059 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f96821fe-232e-454e-a171-4e1431564cb3 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:33.447314 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f96821fe-232e-454e-a171-4e1431564cb3 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1266 microversion: 2.1 time: 0.174469 Sep 05 12:37:33.447914 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 502/987] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:33 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:34.470393 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ad87247e-cfa7-460e-8d87-3310c66fa4f9 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:34.470997 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-ad87247e-cfa7-460e-8d87-3310c66fa4f9 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:34.474094 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:34.478768 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ad87247e-cfa7-460e-8d87-3310c66fa4f9 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:34.479248 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ad87247e-cfa7-460e-8d87-3310c66fa4f9 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:34.479704 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ad87247e-cfa7-460e-8d87-3310c66fa4f9 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:34.480396 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ad87247e-cfa7-460e-8d87-3310c66fa4f9 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:34.480849 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ad87247e-cfa7-460e-8d87-3310c66fa4f9 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:34.486804 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ad87247e-cfa7-460e-8d87-3310c66fa4f9 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:34.627795 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-ad87247e-cfa7-460e-8d87-3310c66fa4f9 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:34.636742 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-ad87247e-cfa7-460e-8d87-3310c66fa4f9 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1452 microversion: 2.1 time: 0.170353 Sep 05 12:37:34.637320 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 486/988] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:34 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:34.664504 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-481347d2-9c3e-4a9d-a299-f47ad5610d99 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:34.665122 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-481347d2-9c3e-4a9d-a299-f47ad5610d99 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:34.671663 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-481347d2-9c3e-4a9d-a299-f47ad5610d99 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:34.672152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-481347d2-9c3e-4a9d-a299-f47ad5610d99 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:34.672588 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-481347d2-9c3e-4a9d-a299-f47ad5610d99 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:34.673298 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-481347d2-9c3e-4a9d-a299-f47ad5610d99 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:34.673759 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-481347d2-9c3e-4a9d-a299-f47ad5610d99 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:34.674187 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-481347d2-9c3e-4a9d-a299-f47ad5610d99 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:34.807755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-481347d2-9c3e-4a9d-a299-f47ad5610d99 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:37:34.816143 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-481347d2-9c3e-4a9d-a299-f47ad5610d99 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1452 microversion: 2.1 time: 0.155363 Sep 05 12:37:34.816721 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 503/989] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:37:34 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:37:37.469087 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-10792a6a-7c67-4d70-96c0-a18bcbec0e71 req-2b65e0ac-b042-480e-a4aa-6aeaba49cbea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d43048-46ef-4843-b1ba-6105a322c05f", "tag": "6b29555c-21f4-47bd-b77b-4b65005e7159"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:37:37.480478 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-10792a6a-7c67-4d70-96c0-a18bcbec0e71 req-2b65e0ac-b042-480e-a4aa-6aeaba49cbea service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:37.481002 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-10792a6a-7c67-4d70-96c0-a18bcbec0e71 req-2b65e0ac-b042-480e-a4aa-6aeaba49cbea service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:37.481523 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-10792a6a-7c67-4d70-96c0-a18bcbec0e71 req-2b65e0ac-b042-480e-a4aa-6aeaba49cbea service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:37.493425 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-10792a6a-7c67-4d70-96c0-a18bcbec0e71 req-2b65e0ac-b042-480e-a4aa-6aeaba49cbea service nova] Creating event network-changed:6b29555c-21f4-47bd-b77b-4b65005e7159 for instance 26d43048-46ef-4843-b1ba-6105a322c05f on hv-cinder-80135 Sep 05 12:37:37.500034 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-10792a6a-7c67-4d70-96c0-a18bcbec0e71 req-2b65e0ac-b042-480e-a4aa-6aeaba49cbea service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034458 Sep 05 12:37:37.500655 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 487/990] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:37:57.467902 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-edd50667-b14c-4d57-b753-1c51fc70b2cc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:37:57.468471 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-edd50667-b14c-4d57-b753-1c51fc70b2cc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:37:57.470770 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=3 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:57.471599 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=11 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:57.476678 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-edd50667-b14c-4d57-b753-1c51fc70b2cc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:57.484232 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-edd50667-b14c-4d57-b753-1c51fc70b2cc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:57.484232 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-edd50667-b14c-4d57-b753-1c51fc70b2cc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:57.484232 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-edd50667-b14c-4d57-b753-1c51fc70b2cc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:37:57.484232 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-edd50667-b14c-4d57-b753-1c51fc70b2cc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:37:57.484814 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-edd50667-b14c-4d57-b753-1c51fc70b2cc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:37:57.504904 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-edd50667-b14c-4d57-b753-1c51fc70b2cc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14/ips" status: 200 len: 145 microversion: 2.1 time: 0.040952 Sep 05 12:37:57.509739 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 504/991] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Sep 5 12:37:57 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:38:01.381688 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=3 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:01.382537 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=18 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:01.387477 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-102c145f-79a8-443e-93b7-2448541c7654 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "757c1209-fb7b-41af-abe0-f877b076fd62"}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:38:01.389792 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-102c145f-79a8-443e-93b7-2448541c7654 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:01.396889 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-102c145f-79a8-443e-93b7-2448541c7654 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:01.397346 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-102c145f-79a8-443e-93b7-2448541c7654 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:01.397909 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-102c145f-79a8-443e-93b7-2448541c7654 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:01.398506 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-102c145f-79a8-443e-93b7-2448541c7654 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:01.399266 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-102c145f-79a8-443e-93b7-2448541c7654 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:01.400388 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-102c145f-79a8-443e-93b7-2448541c7654 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:02.381616 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-102c145f-79a8-443e-93b7-2448541c7654 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "POST /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.001219 Sep 05 12:38:02.382222 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 488/992] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Sep 5 12:38:01 2022] POST /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14/os-volume_attachments => generated 194 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:38:11.024241 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-52187a9b-0297-4b71-8adf-11f8fe092794 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:38:11.031333 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-52187a9b-0297-4b71-8adf-11f8fe092794 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:11.031837 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-52187a9b-0297-4b71-8adf-11f8fe092794 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:11.032271 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-52187a9b-0297-4b71-8adf-11f8fe092794 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:11.096127 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-52187a9b-0297-4b71-8adf-11f8fe092794 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Going to try to stop instance {{(pid=121211) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 05 12:38:11.281271 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-52187a9b-0297-4b71-8adf-11f8fe092794 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "POST /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14/action" status: 202 len: 0 microversion: 2.1 time: 0.261080 Sep 05 12:38:11.281923 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 505/993] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Sep 5 12:38:11 2022] POST /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 05 12:38:11.292160 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-99b473cd-de01-43c6-bd95-a2e5441b19a4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:11.294026 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-99b473cd-de01-43c6-bd95-a2e5441b19a4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:11.299583 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-99b473cd-de01-43c6-bd95-a2e5441b19a4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:11.300018 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-99b473cd-de01-43c6-bd95-a2e5441b19a4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:11.300457 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-99b473cd-de01-43c6-bd95-a2e5441b19a4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:11.301835 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-99b473cd-de01-43c6-bd95-a2e5441b19a4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:11.302302 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-99b473cd-de01-43c6-bd95-a2e5441b19a4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:11.302730 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-99b473cd-de01-43c6-bd95-a2e5441b19a4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:11.443752 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-99b473cd-de01-43c6-bd95-a2e5441b19a4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:11.452648 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-99b473cd-de01-43c6-bd95-a2e5441b19a4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1724 microversion: 2.1 time: 0.165633 Sep 05 12:38:11.453229 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 489/994] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:11 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:12.477821 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-aaa20530-6552-4e7f-9dc8-cfa387a656bd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:12.478826 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-aaa20530-6552-4e7f-9dc8-cfa387a656bd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:12.486339 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aaa20530-6552-4e7f-9dc8-cfa387a656bd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:12.486868 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aaa20530-6552-4e7f-9dc8-cfa387a656bd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:12.487442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aaa20530-6552-4e7f-9dc8-cfa387a656bd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:12.488177 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aaa20530-6552-4e7f-9dc8-cfa387a656bd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:12.488633 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aaa20530-6552-4e7f-9dc8-cfa387a656bd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:12.489059 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aaa20530-6552-4e7f-9dc8-cfa387a656bd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:12.633367 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-aaa20530-6552-4e7f-9dc8-cfa387a656bd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:12.641869 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-aaa20530-6552-4e7f-9dc8-cfa387a656bd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1724 microversion: 2.1 time: 0.169321 Sep 05 12:38:12.642445 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 506/995] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:12 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:13.666560 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-0e41c359-67a3-4ac0-b005-43dfb842c2c3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:13.667193 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-0e41c359-67a3-4ac0-b005-43dfb842c2c3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:13.673539 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0e41c359-67a3-4ac0-b005-43dfb842c2c3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:13.673955 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0e41c359-67a3-4ac0-b005-43dfb842c2c3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:13.674382 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0e41c359-67a3-4ac0-b005-43dfb842c2c3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:13.675090 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0e41c359-67a3-4ac0-b005-43dfb842c2c3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:13.675564 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0e41c359-67a3-4ac0-b005-43dfb842c2c3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:13.675987 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0e41c359-67a3-4ac0-b005-43dfb842c2c3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:13.812588 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-0e41c359-67a3-4ac0-b005-43dfb842c2c3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:13.821653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-0e41c359-67a3-4ac0-b005-43dfb842c2c3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1724 microversion: 2.1 time: 0.159054 Sep 05 12:38:13.822235 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 490/996] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:13 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:14.845493 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-69af7a6d-8598-497a-9cc1-5a0831539051 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:14.846111 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-69af7a6d-8598-497a-9cc1-5a0831539051 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:14.853473 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-69af7a6d-8598-497a-9cc1-5a0831539051 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:14.853958 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-69af7a6d-8598-497a-9cc1-5a0831539051 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:14.854385 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-69af7a6d-8598-497a-9cc1-5a0831539051 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:14.855082 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-69af7a6d-8598-497a-9cc1-5a0831539051 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:14.855559 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-69af7a6d-8598-497a-9cc1-5a0831539051 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:14.855978 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-69af7a6d-8598-497a-9cc1-5a0831539051 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:14.990636 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-69af7a6d-8598-497a-9cc1-5a0831539051 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:14.999662 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-69af7a6d-8598-497a-9cc1-5a0831539051 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1724 microversion: 2.1 time: 0.157923 Sep 05 12:38:15.000235 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 507/997] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:14 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:16.023426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4ad711ca-3021-4373-88c9-a3af0fcb9b5e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:16.024066 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-4ad711ca-3021-4373-88c9-a3af0fcb9b5e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:16.030572 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4ad711ca-3021-4373-88c9-a3af0fcb9b5e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:16.031059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4ad711ca-3021-4373-88c9-a3af0fcb9b5e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:16.031482 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4ad711ca-3021-4373-88c9-a3af0fcb9b5e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:16.032206 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4ad711ca-3021-4373-88c9-a3af0fcb9b5e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:16.032655 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4ad711ca-3021-4373-88c9-a3af0fcb9b5e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:16.033068 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4ad711ca-3021-4373-88c9-a3af0fcb9b5e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:16.171032 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-4ad711ca-3021-4373-88c9-a3af0fcb9b5e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:16.180534 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-4ad711ca-3021-4373-88c9-a3af0fcb9b5e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1724 microversion: 2.1 time: 0.161362 Sep 05 12:38:16.181112 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 491/998] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:16 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:17.204053 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-418db264-c48a-4caf-88de-e6b06dba4724 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:17.204646 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-418db264-c48a-4caf-88de-e6b06dba4724 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:17.211386 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-418db264-c48a-4caf-88de-e6b06dba4724 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:17.211886 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-418db264-c48a-4caf-88de-e6b06dba4724 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:17.212320 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-418db264-c48a-4caf-88de-e6b06dba4724 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:17.213127 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-418db264-c48a-4caf-88de-e6b06dba4724 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:17.213578 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-418db264-c48a-4caf-88de-e6b06dba4724 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:17.213998 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-418db264-c48a-4caf-88de-e6b06dba4724 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:17.353085 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-418db264-c48a-4caf-88de-e6b06dba4724 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:17.361648 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-418db264-c48a-4caf-88de-e6b06dba4724 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1724 microversion: 2.1 time: 0.161458 Sep 05 12:38:17.362220 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 508/999] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:17 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:18.387814 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a3da75a3-6d13-4113-90bb-0061f1bb0035 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:18.388632 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a3da75a3-6d13-4113-90bb-0061f1bb0035 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:18.396425 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a3da75a3-6d13-4113-90bb-0061f1bb0035 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:18.396922 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a3da75a3-6d13-4113-90bb-0061f1bb0035 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:18.397410 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a3da75a3-6d13-4113-90bb-0061f1bb0035 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:18.398342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a3da75a3-6d13-4113-90bb-0061f1bb0035 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:18.398806 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a3da75a3-6d13-4113-90bb-0061f1bb0035 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:18.399232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a3da75a3-6d13-4113-90bb-0061f1bb0035 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:18.584864 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a3da75a3-6d13-4113-90bb-0061f1bb0035 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:18.593492 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a3da75a3-6d13-4113-90bb-0061f1bb0035 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1724 microversion: 2.1 time: 0.210598 Sep 05 12:38:18.594071 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 492/1000] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:18 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:19.617736 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1f0e55b9-60e8-4389-80bf-9be40d79f1d5 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:19.618383 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1f0e55b9-60e8-4389-80bf-9be40d79f1d5 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:19.626984 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1f0e55b9-60e8-4389-80bf-9be40d79f1d5 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:19.626984 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1f0e55b9-60e8-4389-80bf-9be40d79f1d5 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:19.626984 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1f0e55b9-60e8-4389-80bf-9be40d79f1d5 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:19.626984 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1f0e55b9-60e8-4389-80bf-9be40d79f1d5 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:19.627369 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1f0e55b9-60e8-4389-80bf-9be40d79f1d5 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:19.627669 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1f0e55b9-60e8-4389-80bf-9be40d79f1d5 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:19.768814 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1f0e55b9-60e8-4389-80bf-9be40d79f1d5 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:19.778036 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1f0e55b9-60e8-4389-80bf-9be40d79f1d5 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1724 microversion: 2.1 time: 0.164363 Sep 05 12:38:19.778617 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 509/1001] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:19 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:20.803217 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-b02a8097-1621-41c4-a7ef-0108237f0e88 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:20.803779 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-b02a8097-1621-41c4-a7ef-0108237f0e88 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:20.810402 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b02a8097-1621-41c4-a7ef-0108237f0e88 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:20.811149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b02a8097-1621-41c4-a7ef-0108237f0e88 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:20.811599 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b02a8097-1621-41c4-a7ef-0108237f0e88 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:20.812305 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b02a8097-1621-41c4-a7ef-0108237f0e88 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:20.812765 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b02a8097-1621-41c4-a7ef-0108237f0e88 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:20.813184 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-b02a8097-1621-41c4-a7ef-0108237f0e88 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:20.957016 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-b02a8097-1621-41c4-a7ef-0108237f0e88 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:20.966332 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-b02a8097-1621-41c4-a7ef-0108237f0e88 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1724 microversion: 2.1 time: 0.167042 Sep 05 12:38:20.967065 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 493/1002] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:20 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:21.991591 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e46386e0-15bc-4b06-9b8c-5a84059e378b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:21.992295 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e46386e0-15bc-4b06-9b8c-5a84059e378b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:21.999359 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e46386e0-15bc-4b06-9b8c-5a84059e378b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:21.999760 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e46386e0-15bc-4b06-9b8c-5a84059e378b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:22.000208 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e46386e0-15bc-4b06-9b8c-5a84059e378b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:22.000911 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e46386e0-15bc-4b06-9b8c-5a84059e378b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:22.001374 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e46386e0-15bc-4b06-9b8c-5a84059e378b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:22.001800 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e46386e0-15bc-4b06-9b8c-5a84059e378b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:22.140342 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e46386e0-15bc-4b06-9b8c-5a84059e378b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:22.148991 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e46386e0-15bc-4b06-9b8c-5a84059e378b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1724 microversion: 2.1 time: 0.161877 Sep 05 12:38:22.149586 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 510/1003] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:21 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:23.174380 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-29561e9b-9261-48f1-9f8f-cde2c0d11844 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:23.180582 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-29561e9b-9261-48f1-9f8f-cde2c0d11844 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:23.182056 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-29561e9b-9261-48f1-9f8f-cde2c0d11844 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:23.182545 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-29561e9b-9261-48f1-9f8f-cde2c0d11844 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:23.182972 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-29561e9b-9261-48f1-9f8f-cde2c0d11844 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:23.183723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-29561e9b-9261-48f1-9f8f-cde2c0d11844 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:23.184055 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-6ad4f519-ebc1-4969-a914-cacf9dbcf4f0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1190282438", "imageRef": "7844cf5b-4975-4cb9-a7f8-31cc5e52098a", "flavorRef": "452", "networks": [{"uuid": "940f936d-c824-4ec4-900c-187414e9e41b"}]}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:38:23.184507 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-29561e9b-9261-48f1-9f8f-cde2c0d11844 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:23.184606 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-29561e9b-9261-48f1-9f8f-cde2c0d11844 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:23.239909 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.network.neutron [None req-6ad4f519-ebc1-4969-a914-cacf9dbcf4f0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] validate_networks() for [('940f936d-c824-4ec4-900c-187414e9e41b', None, None, None, None, None)] {{(pid=121211) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:38:23.323840 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-29561e9b-9261-48f1-9f8f-cde2c0d11844 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:23.332307 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-29561e9b-9261-48f1-9f8f-cde2c0d11844 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1724 microversion: 2.1 time: 0.162817 Sep 05 12:38:23.332936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 494/1004] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:23 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:23.622824 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-6ad4f519-ebc1-4969-a914-cacf9dbcf4f0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Flavor limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:38:23.623507 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-6ad4f519-ebc1-4969-a914-cacf9dbcf4f0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Image limits 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:38:23.624026 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-6ad4f519-ebc1-4969-a914-cacf9dbcf4f0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Flavor pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:38:23.624439 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-6ad4f519-ebc1-4969-a914-cacf9dbcf4f0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Image pref 0:0:0 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:38:23.624935 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.virt.hardware [None req-6ad4f519-ebc1-4969-a914-cacf9dbcf4f0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121211) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:38:23.633601 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6ad4f519-ebc1-4969-a914-cacf9dbcf4f0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:23.634082 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6ad4f519-ebc1-4969-a914-cacf9dbcf4f0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:23.634515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6ad4f519-ebc1-4969-a914-cacf9dbcf4f0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:23.635328 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6ad4f519-ebc1-4969-a914-cacf9dbcf4f0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:23.635815 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6ad4f519-ebc1-4969-a914-cacf9dbcf4f0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:23.636269 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6ad4f519-ebc1-4969-a914-cacf9dbcf4f0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:23.652912 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-6ad4f519-ebc1-4969-a914-cacf9dbcf4f0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Getting quotas for project 2a77deb0bf54420e90c26e66699b3611. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:38:23.657764 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-6ad4f519-ebc1-4969-a914-cacf9dbcf4f0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Getting quotas for user 6c22d28f87c941afb1fad1cfaf3a5fb2 and project 2a77deb0bf54420e90c26e66699b3611. Resources: {'ram', 'instances', 'cores'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:38:23.670058 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-6ad4f519-ebc1-4969-a914-cacf9dbcf4f0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Going to run 1 instances... {{(pid=121211) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:38:23.672427 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-6ad4f519-ebc1-4969-a914-cacf9dbcf4f0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7844cf5b-4975-4cb9-a7f8-31cc5e52098a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121211) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:38:23.806683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-6ad4f519-ebc1-4969-a914-cacf9dbcf4f0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626570 Sep 05 12:38:23.807330 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 511/1005] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Sep 5 12:38:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 05 12:38:23.820037 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-f1e70de6-be21-43a8-ad6e-77861c53cad8 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:23.820037 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-f1e70de6-be21-43a8-ad6e-77861c53cad8 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:23.875992 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f1e70de6-be21-43a8-ad6e-77861c53cad8 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:23.893350 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-f1e70de6-be21-43a8-ad6e-77861c53cad8 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42" status: 200 len: 1219 microversion: 2.1 time: 0.078791 Sep 05 12:38:23.894096 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 495/1006] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:23 2022] GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:24.356746 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f6923037-6471-4722-8dd1-de3b1bb9068e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:24.357377 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f6923037-6471-4722-8dd1-de3b1bb9068e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:24.365243 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f6923037-6471-4722-8dd1-de3b1bb9068e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:24.365732 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f6923037-6471-4722-8dd1-de3b1bb9068e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:24.366166 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f6923037-6471-4722-8dd1-de3b1bb9068e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:24.366917 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f6923037-6471-4722-8dd1-de3b1bb9068e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:24.367374 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f6923037-6471-4722-8dd1-de3b1bb9068e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:24.367812 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f6923037-6471-4722-8dd1-de3b1bb9068e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:24.514101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f6923037-6471-4722-8dd1-de3b1bb9068e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:24.523286 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f6923037-6471-4722-8dd1-de3b1bb9068e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1724 microversion: 2.1 time: 0.170927 Sep 05 12:38:24.523912 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 512/1007] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:24 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:24.918438 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-89cc4190-a20c-44df-b9ac-6fa2f78043f3 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:24.919057 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-89cc4190-a20c-44df-b9ac-6fa2f78043f3 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:24.972605 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-89cc4190-a20c-44df-b9ac-6fa2f78043f3 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:24.980389 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-89cc4190-a20c-44df-b9ac-6fa2f78043f3 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42" status: 200 len: 1219 microversion: 2.1 time: 0.065952 Sep 05 12:38:24.980958 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 496/1008] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:24 2022] GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:25.547870 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-95ad10b8-471a-41fb-bed5-f2d8d8c01fdc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:25.548474 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-95ad10b8-471a-41fb-bed5-f2d8d8c01fdc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:25.559366 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-95ad10b8-471a-41fb-bed5-f2d8d8c01fdc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:25.559366 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-95ad10b8-471a-41fb-bed5-f2d8d8c01fdc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:25.559366 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-95ad10b8-471a-41fb-bed5-f2d8d8c01fdc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:25.559366 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-95ad10b8-471a-41fb-bed5-f2d8d8c01fdc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:25.559873 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-95ad10b8-471a-41fb-bed5-f2d8d8c01fdc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:25.559873 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-95ad10b8-471a-41fb-bed5-f2d8d8c01fdc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:25.693080 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-95ad10b8-471a-41fb-bed5-f2d8d8c01fdc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:25.702544 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-95ad10b8-471a-41fb-bed5-f2d8d8c01fdc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1724 microversion: 2.1 time: 0.157743 Sep 05 12:38:25.702544 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 513/1009] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:25 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:26.003432 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-f1a973c6-aa51-43fb-bec1-4829a4eebcaf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:26.003993 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-f1a973c6-aa51-43fb-bec1-4829a4eebcaf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:26.010780 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f1a973c6-aa51-43fb-bec1-4829a4eebcaf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:26.011263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f1a973c6-aa51-43fb-bec1-4829a4eebcaf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:26.011725 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f1a973c6-aa51-43fb-bec1-4829a4eebcaf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:26.019261 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f1a973c6-aa51-43fb-bec1-4829a4eebcaf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:26.019261 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f1a973c6-aa51-43fb-bec1-4829a4eebcaf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:26.019261 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f1a973c6-aa51-43fb-bec1-4829a4eebcaf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:26.078591 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f1a973c6-aa51-43fb-bec1-4829a4eebcaf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:26.089106 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-f1a973c6-aa51-43fb-bec1-4829a4eebcaf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42" status: 200 len: 1271 microversion: 2.1 time: 0.089824 Sep 05 12:38:26.089687 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 497/1010] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:25 2022] GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:26.725775 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e1a3b0db-deb5-4cdc-b4a1-d007ab11f300 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:26.727880 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e1a3b0db-deb5-4cdc-b4a1-d007ab11f300 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:26.734459 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e1a3b0db-deb5-4cdc-b4a1-d007ab11f300 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:26.735010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e1a3b0db-deb5-4cdc-b4a1-d007ab11f300 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:26.735615 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e1a3b0db-deb5-4cdc-b4a1-d007ab11f300 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:26.736321 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e1a3b0db-deb5-4cdc-b4a1-d007ab11f300 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:26.737089 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e1a3b0db-deb5-4cdc-b4a1-d007ab11f300 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:26.737514 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e1a3b0db-deb5-4cdc-b4a1-d007ab11f300 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:26.963276 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e1a3b0db-deb5-4cdc-b4a1-d007ab11f300 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:26.976071 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e1a3b0db-deb5-4cdc-b4a1-d007ab11f300 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1724 microversion: 2.1 time: 0.254823 Sep 05 12:38:26.976656 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 514/1011] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:26 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:27.114969 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-f4652822-ecdd-475e-a4d1-5664a0384b22 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:27.115693 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-f4652822-ecdd-475e-a4d1-5664a0384b22 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:27.122268 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f4652822-ecdd-475e-a4d1-5664a0384b22 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:27.122749 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f4652822-ecdd-475e-a4d1-5664a0384b22 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:27.123175 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f4652822-ecdd-475e-a4d1-5664a0384b22 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:27.124150 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f4652822-ecdd-475e-a4d1-5664a0384b22 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:27.124598 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f4652822-ecdd-475e-a4d1-5664a0384b22 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:27.125014 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f4652822-ecdd-475e-a4d1-5664a0384b22 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:27.205545 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f4652822-ecdd-475e-a4d1-5664a0384b22 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:27.214017 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-f4652822-ecdd-475e-a4d1-5664a0384b22 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42" status: 200 len: 1277 microversion: 2.1 time: 0.103047 Sep 05 12:38:27.214594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 498/1012] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:27 2022] GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42 => generated 1277 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:28.000487 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-2cd92ee7-0646-4a1c-81fb-8db34f0b5d03 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:28.001149 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-2cd92ee7-0646-4a1c-81fb-8db34f0b5d03 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:28.008161 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2cd92ee7-0646-4a1c-81fb-8db34f0b5d03 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:28.008586 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2cd92ee7-0646-4a1c-81fb-8db34f0b5d03 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:28.009023 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2cd92ee7-0646-4a1c-81fb-8db34f0b5d03 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:28.009750 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2cd92ee7-0646-4a1c-81fb-8db34f0b5d03 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:28.010188 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2cd92ee7-0646-4a1c-81fb-8db34f0b5d03 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:28.010617 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2cd92ee7-0646-4a1c-81fb-8db34f0b5d03 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:28.213039 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-2cd92ee7-0646-4a1c-81fb-8db34f0b5d03 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:28.221555 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-2cd92ee7-0646-4a1c-81fb-8db34f0b5d03 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1724 microversion: 2.1 time: 0.225144 Sep 05 12:38:28.222374 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 515/1013] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:27 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:28.240614 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-167932d9-34af-4a78-8002-177c7633d767 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:28.241396 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-167932d9-34af-4a78-8002-177c7633d767 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:28.247975 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-167932d9-34af-4a78-8002-177c7633d767 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:28.248727 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-167932d9-34af-4a78-8002-177c7633d767 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:28.249157 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-167932d9-34af-4a78-8002-177c7633d767 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:28.249866 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-167932d9-34af-4a78-8002-177c7633d767 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:28.250318 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-167932d9-34af-4a78-8002-177c7633d767 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:28.250783 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-167932d9-34af-4a78-8002-177c7633d767 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:28.390540 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-167932d9-34af-4a78-8002-177c7633d767 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:28.400440 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-167932d9-34af-4a78-8002-177c7633d767 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42" status: 200 len: 1319 microversion: 2.1 time: 0.166727 Sep 05 12:38:28.401181 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 499/1014] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:28 2022] GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:28.409151 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-3291b33b-99d0-4f2f-96ea-f71239ddf066 req-ac115522-14ac-4298-8e79-63bf79012543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7761d354-80bf-44da-a290-3d35fa7a7a42", "tag": "c2250e16-86aa-47dd-9cb2-2fac74ef3dd1"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:38:28.419652 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-3291b33b-99d0-4f2f-96ea-f71239ddf066 req-ac115522-14ac-4298-8e79-63bf79012543 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:28.420137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-3291b33b-99d0-4f2f-96ea-f71239ddf066 req-ac115522-14ac-4298-8e79-63bf79012543 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:28.420567 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-3291b33b-99d0-4f2f-96ea-f71239ddf066 req-ac115522-14ac-4298-8e79-63bf79012543 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:28.432013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-3291b33b-99d0-4f2f-96ea-f71239ddf066 req-ac115522-14ac-4298-8e79-63bf79012543 service nova] Creating event network-changed:c2250e16-86aa-47dd-9cb2-2fac74ef3dd1 for instance 7761d354-80bf-44da-a290-3d35fa7a7a42 on hv-cinder-80135 Sep 05 12:38:28.437016 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-3291b33b-99d0-4f2f-96ea-f71239ddf066 req-ac115522-14ac-4298-8e79-63bf79012543 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031471 Sep 05 12:38:28.437773 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 516/1015] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:38:29.246266 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ac4ee279-0339-4ee9-8b02-56d70f6473a4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:29.246971 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-ac4ee279-0339-4ee9-8b02-56d70f6473a4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:29.253925 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ac4ee279-0339-4ee9-8b02-56d70f6473a4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:29.254475 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ac4ee279-0339-4ee9-8b02-56d70f6473a4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:29.256224 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ac4ee279-0339-4ee9-8b02-56d70f6473a4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:29.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ac4ee279-0339-4ee9-8b02-56d70f6473a4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:29.257629 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ac4ee279-0339-4ee9-8b02-56d70f6473a4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:29.258653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ac4ee279-0339-4ee9-8b02-56d70f6473a4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:29.392617 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-ac4ee279-0339-4ee9-8b02-56d70f6473a4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:29.400889 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-ac4ee279-0339-4ee9-8b02-56d70f6473a4 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1724 microversion: 2.1 time: 0.158766 Sep 05 12:38:29.401458 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 500/1016] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:29 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:29.425456 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3751f48d-5d03-4eec-b861-15e84c378aa6 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:29.426158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-3751f48d-5d03-4eec-b861-15e84c378aa6 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:29.433283 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3751f48d-5d03-4eec-b861-15e84c378aa6 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:29.433764 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3751f48d-5d03-4eec-b861-15e84c378aa6 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:29.434196 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3751f48d-5d03-4eec-b861-15e84c378aa6 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:29.434885 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3751f48d-5d03-4eec-b861-15e84c378aa6 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:29.435340 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3751f48d-5d03-4eec-b861-15e84c378aa6 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:29.435922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3751f48d-5d03-4eec-b861-15e84c378aa6 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:29.568261 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3751f48d-5d03-4eec-b861-15e84c378aa6 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:29.576214 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3751f48d-5d03-4eec-b861-15e84c378aa6 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42" status: 200 len: 1319 microversion: 2.1 time: 0.155549 Sep 05 12:38:29.577112 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 517/1017] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:29 2022] GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:30.424809 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1b10d1e4-2567-4dca-8fb0-1a64f0929170 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:30.425382 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1b10d1e4-2567-4dca-8fb0-1a64f0929170 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:30.432575 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1b10d1e4-2567-4dca-8fb0-1a64f0929170 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:30.433151 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1b10d1e4-2567-4dca-8fb0-1a64f0929170 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:30.433702 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1b10d1e4-2567-4dca-8fb0-1a64f0929170 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:30.434406 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1b10d1e4-2567-4dca-8fb0-1a64f0929170 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:30.434861 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1b10d1e4-2567-4dca-8fb0-1a64f0929170 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:30.435284 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1b10d1e4-2567-4dca-8fb0-1a64f0929170 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:30.574574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1b10d1e4-2567-4dca-8fb0-1a64f0929170 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:30.583138 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1b10d1e4-2567-4dca-8fb0-1a64f0929170 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1724 microversion: 2.1 time: 0.162274 Sep 05 12:38:30.583750 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 501/1018] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:30 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:30.598681 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-532cd615-b1a7-4021-9a62-6c71b4dac6cf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:30.599349 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-532cd615-b1a7-4021-9a62-6c71b4dac6cf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:30.606146 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-532cd615-b1a7-4021-9a62-6c71b4dac6cf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:30.606668 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-532cd615-b1a7-4021-9a62-6c71b4dac6cf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:30.607100 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-532cd615-b1a7-4021-9a62-6c71b4dac6cf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:30.607828 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-532cd615-b1a7-4021-9a62-6c71b4dac6cf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:30.608281 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-532cd615-b1a7-4021-9a62-6c71b4dac6cf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:30.608706 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-532cd615-b1a7-4021-9a62-6c71b4dac6cf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:30.747904 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-532cd615-b1a7-4021-9a62-6c71b4dac6cf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:30.756374 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-532cd615-b1a7-4021-9a62-6c71b4dac6cf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42" status: 200 len: 1319 microversion: 2.1 time: 0.161883 Sep 05 12:38:30.756933 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 518/1019] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:30 2022] GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:31.606127 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-25aad98b-58fc-487c-99f7-b1ef62e4ab07 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:31.606779 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-25aad98b-58fc-487c-99f7-b1ef62e4ab07 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:31.609302 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=33 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:31.614100 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-25aad98b-58fc-487c-99f7-b1ef62e4ab07 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:31.614592 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-25aad98b-58fc-487c-99f7-b1ef62e4ab07 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:31.615023 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-25aad98b-58fc-487c-99f7-b1ef62e4ab07 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:31.615761 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-25aad98b-58fc-487c-99f7-b1ef62e4ab07 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:31.616216 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-25aad98b-58fc-487c-99f7-b1ef62e4ab07 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:31.620981 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-25aad98b-58fc-487c-99f7-b1ef62e4ab07 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:31.620981 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:31.751846 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-25aad98b-58fc-487c-99f7-b1ef62e4ab07 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:31.762191 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-25aad98b-58fc-487c-99f7-b1ef62e4ab07 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1724 microversion: 2.1 time: 0.159867 Sep 05 12:38:31.762779 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 502/1020] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:31 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:31.778768 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-b12f8b7d-2683-4440-93d7-2413136f700e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:31.779380 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-b12f8b7d-2683-4440-93d7-2413136f700e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:31.786764 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b12f8b7d-2683-4440-93d7-2413136f700e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:31.787330 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b12f8b7d-2683-4440-93d7-2413136f700e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:31.787723 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b12f8b7d-2683-4440-93d7-2413136f700e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:31.788445 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b12f8b7d-2683-4440-93d7-2413136f700e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:31.788902 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b12f8b7d-2683-4440-93d7-2413136f700e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:31.789336 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b12f8b7d-2683-4440-93d7-2413136f700e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:31.932862 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-b12f8b7d-2683-4440-93d7-2413136f700e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:31.941557 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-b12f8b7d-2683-4440-93d7-2413136f700e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42" status: 200 len: 1319 microversion: 2.1 time: 0.166575 Sep 05 12:38:31.942972 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 519/1021] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:31 2022] GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:32.787357 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ba8319b1-6e6e-4bb4-b506-9352a6c87aea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:32.788024 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-ba8319b1-6e6e-4bb4-b506-9352a6c87aea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:32.794675 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ba8319b1-6e6e-4bb4-b506-9352a6c87aea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:32.795163 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ba8319b1-6e6e-4bb4-b506-9352a6c87aea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:32.795622 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ba8319b1-6e6e-4bb4-b506-9352a6c87aea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:32.796329 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ba8319b1-6e6e-4bb4-b506-9352a6c87aea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:32.796781 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ba8319b1-6e6e-4bb4-b506-9352a6c87aea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:32.797203 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ba8319b1-6e6e-4bb4-b506-9352a6c87aea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:32.932670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-ba8319b1-6e6e-4bb4-b506-9352a6c87aea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:32.941344 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-ba8319b1-6e6e-4bb4-b506-9352a6c87aea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1701 microversion: 2.1 time: 0.158911 Sep 05 12:38:32.941937 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 503/1022] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:32 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1701 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:32.965112 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1339f5e3-465b-489c-9b65-d785e8811ddc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:32.965675 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-db573257-e5a1-4417-b2c9-99545143f430 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:38:32.965788 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1339f5e3-465b-489c-9b65-d785e8811ddc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:32.971729 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-db573257-e5a1-4417-b2c9-99545143f430 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:32.972429 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1339f5e3-465b-489c-9b65-d785e8811ddc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:32.972583 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-db573257-e5a1-4417-b2c9-99545143f430 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:32.972919 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1339f5e3-465b-489c-9b65-d785e8811ddc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:32.973051 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-db573257-e5a1-4417-b2c9-99545143f430 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:32.973356 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1339f5e3-465b-489c-9b65-d785e8811ddc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:32.974636 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1339f5e3-465b-489c-9b65-d785e8811ddc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:32.975129 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1339f5e3-465b-489c-9b65-d785e8811ddc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:32.975575 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1339f5e3-465b-489c-9b65-d785e8811ddc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:33.040447 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-db573257-e5a1-4417-b2c9-99545143f430 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Going to try to start instance {{(pid=121210) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 05 12:38:33.116250 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1339f5e3-465b-489c-9b65-d785e8811ddc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:33.124376 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1339f5e3-465b-489c-9b65-d785e8811ddc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42" status: 200 len: 1319 microversion: 2.1 time: 0.163087 Sep 05 12:38:33.124954 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 520/1023] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:32 2022] GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:33.241734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-db573257-e5a1-4417-b2c9-99545143f430 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "POST /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14/action" status: 202 len: 0 microversion: 2.1 time: 0.280177 Sep 05 12:38:33.242499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 504/1024] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Sep 5 12:38:32 2022] POST /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 05 12:38:33.251056 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8a1c40ca-63ed-4f22-b7e4-0315a7a451ba tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:33.251713 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-8a1c40ca-63ed-4f22-b7e4-0315a7a451ba tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:33.258237 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8a1c40ca-63ed-4f22-b7e4-0315a7a451ba tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:33.258733 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8a1c40ca-63ed-4f22-b7e4-0315a7a451ba tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:33.259177 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8a1c40ca-63ed-4f22-b7e4-0315a7a451ba tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:33.259922 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8a1c40ca-63ed-4f22-b7e4-0315a7a451ba tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:33.260382 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8a1c40ca-63ed-4f22-b7e4-0315a7a451ba tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:33.260814 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8a1c40ca-63ed-4f22-b7e4-0315a7a451ba tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:33.265232 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:33.398566 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-8a1c40ca-63ed-4f22-b7e4-0315a7a451ba tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:33.412692 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-8a1c40ca-63ed-4f22-b7e4-0315a7a451ba tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1710 microversion: 2.1 time: 0.165815 Sep 05 12:38:33.413283 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 521/1025] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:33 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1710 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:33.665912 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-203792ac-6de6-474f-a0bf-7cb053aafa00 req-e11beab5-869f-47d3-a1da-b98a94f4e5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7761d354-80bf-44da-a290-3d35fa7a7a42", "name": "network-vif-plugged", "status": "completed", "tag": "c2250e16-86aa-47dd-9cb2-2fac74ef3dd1"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:38:33.676418 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-203792ac-6de6-474f-a0bf-7cb053aafa00 req-e11beab5-869f-47d3-a1da-b98a94f4e5f1 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:33.677506 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-203792ac-6de6-474f-a0bf-7cb053aafa00 req-e11beab5-869f-47d3-a1da-b98a94f4e5f1 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:33.677959 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-203792ac-6de6-474f-a0bf-7cb053aafa00 req-e11beab5-869f-47d3-a1da-b98a94f4e5f1 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:33.689529 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-203792ac-6de6-474f-a0bf-7cb053aafa00 req-e11beab5-869f-47d3-a1da-b98a94f4e5f1 service nova] Creating event network-vif-plugged:c2250e16-86aa-47dd-9cb2-2fac74ef3dd1 for instance 7761d354-80bf-44da-a290-3d35fa7a7a42 on hv-cinder-80135 Sep 05 12:38:33.695073 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-203792ac-6de6-474f-a0bf-7cb053aafa00 req-e11beab5-869f-47d3-a1da-b98a94f4e5f1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034018 Sep 05 12:38:33.696069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 505/1026] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:38:34.144867 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=2 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:34.145729 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=6 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:34.150305 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-91e4d650-c92a-4e42-a163-480f76ec09ce tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:34.150995 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-91e4d650-c92a-4e42-a163-480f76ec09ce tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:34.158012 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-91e4d650-c92a-4e42-a163-480f76ec09ce tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:34.158515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-91e4d650-c92a-4e42-a163-480f76ec09ce tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:34.158953 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-91e4d650-c92a-4e42-a163-480f76ec09ce tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:34.159717 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-91e4d650-c92a-4e42-a163-480f76ec09ce tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:34.160183 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-91e4d650-c92a-4e42-a163-480f76ec09ce tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:34.160618 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-91e4d650-c92a-4e42-a163-480f76ec09ce tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:34.442101 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-5473bb61-ec8a-4382-85a1-893a8694b479 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:34.442798 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-5473bb61-ec8a-4382-85a1-893a8694b479 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:34.449317 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5473bb61-ec8a-4382-85a1-893a8694b479 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:34.449810 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5473bb61-ec8a-4382-85a1-893a8694b479 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:34.450246 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5473bb61-ec8a-4382-85a1-893a8694b479 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:34.450948 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5473bb61-ec8a-4382-85a1-893a8694b479 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:34.451402 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5473bb61-ec8a-4382-85a1-893a8694b479 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:34.451963 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5473bb61-ec8a-4382-85a1-893a8694b479 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:34.472619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-91e4d650-c92a-4e42-a163-480f76ec09ce tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:34.483552 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-91e4d650-c92a-4e42-a163-480f76ec09ce tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42" status: 200 len: 1319 microversion: 2.1 time: 0.340072 Sep 05 12:38:34.484151 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 522/1027] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:34 2022] GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42 => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:34.591262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-5473bb61-ec8a-4382-85a1-893a8694b479 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:34.599832 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-5473bb61-ec8a-4382-85a1-893a8694b479 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1710 microversion: 2.1 time: 0.162518 Sep 05 12:38:34.600410 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 506/1028] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:34 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1710 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:38:35.506404 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-02366c41-1080-4e72-a0b2-9d756a0971dc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:35.507515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-02366c41-1080-4e72-a0b2-9d756a0971dc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:35.514404 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-02366c41-1080-4e72-a0b2-9d756a0971dc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:35.514888 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-02366c41-1080-4e72-a0b2-9d756a0971dc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:35.515394 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-02366c41-1080-4e72-a0b2-9d756a0971dc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:35.516098 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-02366c41-1080-4e72-a0b2-9d756a0971dc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:35.516556 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-02366c41-1080-4e72-a0b2-9d756a0971dc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:35.517024 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-02366c41-1080-4e72-a0b2-9d756a0971dc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:35.622334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-705a3c30-f783-44e8-8dc4-97e1632ffe59 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:35.622965 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-705a3c30-f783-44e8-8dc4-97e1632ffe59 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:35.625230 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=4 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:35.630763 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-705a3c30-f783-44e8-8dc4-97e1632ffe59 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:35.631249 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-705a3c30-f783-44e8-8dc4-97e1632ffe59 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:35.631755 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-705a3c30-f783-44e8-8dc4-97e1632ffe59 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:35.632457 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-705a3c30-f783-44e8-8dc4-97e1632ffe59 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:35.632908 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-705a3c30-f783-44e8-8dc4-97e1632ffe59 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:35.633322 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-705a3c30-f783-44e8-8dc4-97e1632ffe59 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:35.659427 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-02366c41-1080-4e72-a0b2-9d756a0971dc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:35.668451 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-02366c41-1080-4e72-a0b2-9d756a0971dc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42" status: 200 len: 1319 microversion: 2.1 time: 0.165881 Sep 05 12:38:35.669143 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 523/1029] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:35 2022] GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:35.776880 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-705a3c30-f783-44e8-8dc4-97e1632ffe59 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:35.785313 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-705a3c30-f783-44e8-8dc4-97e1632ffe59 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1710 microversion: 2.1 time: 0.166913 Sep 05 12:38:35.785898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 507/1030] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:35 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1710 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:38:36.692877 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-bd96fbee-885b-4073-98ca-dad8f6260058 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:36.693610 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-bd96fbee-885b-4073-98ca-dad8f6260058 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:36.700188 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bd96fbee-885b-4073-98ca-dad8f6260058 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:36.700674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bd96fbee-885b-4073-98ca-dad8f6260058 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:36.701152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bd96fbee-885b-4073-98ca-dad8f6260058 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:36.701859 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bd96fbee-885b-4073-98ca-dad8f6260058 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:36.702315 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bd96fbee-885b-4073-98ca-dad8f6260058 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:36.702738 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bd96fbee-885b-4073-98ca-dad8f6260058 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:36.808907 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1ca798dc-7c4e-4398-adc5-2077e24afb31 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:38:36.809557 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1ca798dc-7c4e-4398-adc5-2077e24afb31 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:36.816507 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1ca798dc-7c4e-4398-adc5-2077e24afb31 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:36.817003 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1ca798dc-7c4e-4398-adc5-2077e24afb31 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:36.817683 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1ca798dc-7c4e-4398-adc5-2077e24afb31 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:36.818408 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1ca798dc-7c4e-4398-adc5-2077e24afb31 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:36.818867 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1ca798dc-7c4e-4398-adc5-2077e24afb31 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:36.819326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1ca798dc-7c4e-4398-adc5-2077e24afb31 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:36.836471 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-bd96fbee-885b-4073-98ca-dad8f6260058 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:36.844186 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-bd96fbee-885b-4073-98ca-dad8f6260058 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42" status: 200 len: 1509 microversion: 2.1 time: 0.155854 Sep 05 12:38:36.844763 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 524/1031] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:36 2022] GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:38:36.965045 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1ca798dc-7c4e-4398-adc5-2077e24afb31 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:38:36.974143 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1ca798dc-7c4e-4398-adc5-2077e24afb31 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1714 microversion: 2.1 time: 0.168549 Sep 05 12:38:36.974717 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 508/1032] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:38:36 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1714 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:38:53.399802 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3c615daf-d650-435d-9983-df9a9bc5949f tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55995236-9d60-4d62-af42-ccb429e4d695", "device": "/dev/sdb"}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:38:53.402682 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-3c615daf-d650-435d-9983-df9a9bc5949f tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:38:53.404995 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:53.405650 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=22 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:53.410284 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3c615daf-d650-435d-9983-df9a9bc5949f tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:53.410765 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3c615daf-d650-435d-9983-df9a9bc5949f tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:53.411201 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3c615daf-d650-435d-9983-df9a9bc5949f tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:53.411914 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3c615daf-d650-435d-9983-df9a9bc5949f tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:38:53.412368 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3c615daf-d650-435d-9983-df9a9bc5949f tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:38:53.412790 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3c615daf-d650-435d-9983-df9a9bc5949f tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:38:54.280518 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3c615daf-d650-435d-9983-df9a9bc5949f tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "POST /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.884564 Sep 05 12:38:54.281102 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 525/1033] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Sep 5 12:38:53 2022] POST /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42/os-volume_attachments => generated 194 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:39:14.469426 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=2 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:14.470073 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-05bf3c22-eba7-4464-973e-e075b2bd80ad tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:14.470073 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-05bf3c22-eba7-4464-973e-e075b2bd80ad tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:14.470507 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:14.472755 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=13 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:14.473425 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:14.474659 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-5aa9d300-1f0b-4324-94a2-19f988c6678c req-cfab3097-178e-4ebb-998f-e5e55c199883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d43048-46ef-4843-b1ba-6105a322c05f", "tag": "6b29555c-21f4-47bd-b77b-4b65005e7159"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:39:14.478561 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-05bf3c22-eba7-4464-973e-e075b2bd80ad tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:14.479062 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-05bf3c22-eba7-4464-973e-e075b2bd80ad tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:14.479528 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-05bf3c22-eba7-4464-973e-e075b2bd80ad tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:14.480234 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-05bf3c22-eba7-4464-973e-e075b2bd80ad tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:14.481609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-05bf3c22-eba7-4464-973e-e075b2bd80ad tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:14.481813 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-05bf3c22-eba7-4464-973e-e075b2bd80ad tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:14.486178 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-5aa9d300-1f0b-4324-94a2-19f988c6678c req-cfab3097-178e-4ebb-998f-e5e55c199883 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:14.486178 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-5aa9d300-1f0b-4324-94a2-19f988c6678c req-cfab3097-178e-4ebb-998f-e5e55c199883 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:14.486676 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-5aa9d300-1f0b-4324-94a2-19f988c6678c req-cfab3097-178e-4ebb-998f-e5e55c199883 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:14.500142 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-5aa9d300-1f0b-4324-94a2-19f988c6678c req-cfab3097-178e-4ebb-998f-e5e55c199883 service nova] Creating event network-changed:6b29555c-21f4-47bd-b77b-4b65005e7159 for instance 26d43048-46ef-4843-b1ba-6105a322c05f on hv-cinder-80135 Sep 05 12:39:14.509449 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-5aa9d300-1f0b-4324-94a2-19f988c6678c req-cfab3097-178e-4ebb-998f-e5e55c199883 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037760 Sep 05 12:39:14.509449 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 526/1034] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:39:14.518248 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-05bf3c22-eba7-4464-973e-e075b2bd80ad tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Going to try to terminate instance {{(pid=121210) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:39:14.799443 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-05bf3c22-eba7-4464-973e-e075b2bd80ad tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "DELETE /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 204 len: 0 microversion: 2.1 time: 0.333748 Sep 05 12:39:14.800110 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 509/1035] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:39:14 2022] DELETE /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:39:14.810649 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d410a816-b8f5-4ab2-9c75-1df9f7152bad tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:14.816617 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d410a816-b8f5-4ab2-9c75-1df9f7152bad tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:14.818578 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d410a816-b8f5-4ab2-9c75-1df9f7152bad tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:14.819080 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d410a816-b8f5-4ab2-9c75-1df9f7152bad tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:14.819518 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d410a816-b8f5-4ab2-9c75-1df9f7152bad tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:14.820261 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d410a816-b8f5-4ab2-9c75-1df9f7152bad tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:14.820719 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d410a816-b8f5-4ab2-9c75-1df9f7152bad tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:14.821153 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d410a816-b8f5-4ab2-9c75-1df9f7152bad tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:15.113861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d410a816-b8f5-4ab2-9c75-1df9f7152bad tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:15.122042 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d410a816-b8f5-4ab2-9c75-1df9f7152bad tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1577 microversion: 2.1 time: 0.316257 Sep 05 12:39:15.122930 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 527/1036] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:14 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1577 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:16.146437 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-30f0aa00-3826-4333-9537-42b462124090 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:16.147129 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-30f0aa00-3826-4333-9537-42b462124090 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:16.154887 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-30f0aa00-3826-4333-9537-42b462124090 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:16.155371 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-30f0aa00-3826-4333-9537-42b462124090 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:16.156160 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-30f0aa00-3826-4333-9537-42b462124090 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:16.156638 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-30f0aa00-3826-4333-9537-42b462124090 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:16.157089 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-30f0aa00-3826-4333-9537-42b462124090 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:16.157509 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-30f0aa00-3826-4333-9537-42b462124090 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:16.354175 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-30f0aa00-3826-4333-9537-42b462124090 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:16.362757 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-30f0aa00-3826-4333-9537-42b462124090 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1577 microversion: 2.1 time: 0.220834 Sep 05 12:39:16.363334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 510/1037] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:16 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1577 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:17.390016 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-91c67484-0f11-4b83-aaee-147983ee7427 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:17.390700 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-91c67484-0f11-4b83-aaee-147983ee7427 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:17.397547 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-91c67484-0f11-4b83-aaee-147983ee7427 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:17.398019 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-91c67484-0f11-4b83-aaee-147983ee7427 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:17.398461 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-91c67484-0f11-4b83-aaee-147983ee7427 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:17.399164 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-91c67484-0f11-4b83-aaee-147983ee7427 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:17.399661 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-91c67484-0f11-4b83-aaee-147983ee7427 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:17.400093 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-91c67484-0f11-4b83-aaee-147983ee7427 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:17.591707 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-91c67484-0f11-4b83-aaee-147983ee7427 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:17.599696 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-91c67484-0f11-4b83-aaee-147983ee7427 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1577 microversion: 2.1 time: 0.216262 Sep 05 12:39:17.600195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 528/1038] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:17 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1577 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:18.219602 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-995b4300-1e58-4dbe-ac87-f92401e87f11 req-636bd0a8-4e3d-4723-9ae9-c19e5fb119f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d43048-46ef-4843-b1ba-6105a322c05f", "name": "network-vif-deleted", "tag": "6b29555c-21f4-47bd-b77b-4b65005e7159"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:39:18.231395 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-995b4300-1e58-4dbe-ac87-f92401e87f11 req-636bd0a8-4e3d-4723-9ae9-c19e5fb119f5 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:18.231996 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-995b4300-1e58-4dbe-ac87-f92401e87f11 req-636bd0a8-4e3d-4723-9ae9-c19e5fb119f5 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:18.237861 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-995b4300-1e58-4dbe-ac87-f92401e87f11 req-636bd0a8-4e3d-4723-9ae9-c19e5fb119f5 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:18.244195 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-995b4300-1e58-4dbe-ac87-f92401e87f11 req-636bd0a8-4e3d-4723-9ae9-c19e5fb119f5 service nova] Creating event network-vif-deleted:6b29555c-21f4-47bd-b77b-4b65005e7159 for instance 26d43048-46ef-4843-b1ba-6105a322c05f on hv-cinder-80135 Sep 05 12:39:18.250176 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-995b4300-1e58-4dbe-ac87-f92401e87f11 req-636bd0a8-4e3d-4723-9ae9-c19e5fb119f5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034230 Sep 05 12:39:18.250868 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 511/1039] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:39:18.624738 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-6e19e6a6-69e9-467f-a47c-e5db708c4cda tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:18.629474 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-6e19e6a6-69e9-467f-a47c-e5db708c4cda tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:18.633276 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6e19e6a6-69e9-467f-a47c-e5db708c4cda tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:18.633780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6e19e6a6-69e9-467f-a47c-e5db708c4cda tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:18.634211 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6e19e6a6-69e9-467f-a47c-e5db708c4cda tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:18.635074 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6e19e6a6-69e9-467f-a47c-e5db708c4cda tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:18.635517 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6e19e6a6-69e9-467f-a47c-e5db708c4cda tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:18.635969 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6e19e6a6-69e9-467f-a47c-e5db708c4cda tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:18.705809 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6e19e6a6-69e9-467f-a47c-e5db708c4cda tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:18.710436 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-6e19e6a6-69e9-467f-a47c-e5db708c4cda tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1225 microversion: 2.1 time: 0.090330 Sep 05 12:39:18.711203 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 529/1040] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:18 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:19.734874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-0c4f0892-5676-4ff1-a1d2-b7a3fdba049a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:19.735595 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-0c4f0892-5676-4ff1-a1d2-b7a3fdba049a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:19.742469 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0c4f0892-5676-4ff1-a1d2-b7a3fdba049a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:19.745874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0c4f0892-5676-4ff1-a1d2-b7a3fdba049a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:19.745874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0c4f0892-5676-4ff1-a1d2-b7a3fdba049a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:19.745874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0c4f0892-5676-4ff1-a1d2-b7a3fdba049a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:19.745874 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0c4f0892-5676-4ff1-a1d2-b7a3fdba049a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:19.746289 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0c4f0892-5676-4ff1-a1d2-b7a3fdba049a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:19.779522 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0c4f0892-5676-4ff1-a1d2-b7a3fdba049a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:19.780068 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0c4f0892-5676-4ff1-a1d2-b7a3fdba049a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:19.780482 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0c4f0892-5676-4ff1-a1d2-b7a3fdba049a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:19.781233 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-0c4f0892-5676-4ff1-a1d2-b7a3fdba049a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lazy-loading 'fault' on Instance uuid 26d43048-46ef-4843-b1ba-6105a322c05f {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:39:19.827192 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-0c4f0892-5676-4ff1-a1d2-b7a3fdba049a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:19.835368 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-0c4f0892-5676-4ff1-a1d2-b7a3fdba049a tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 200 len: 1230 microversion: 2.1 time: 0.105284 Sep 05 12:39:19.835971 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 512/1041] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:19 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 1230 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:20.065321 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-9c82acf0-4f9c-4805-9f73-bb513fd052d0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:20.066673 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-9c82acf0-4f9c-4805-9f73-bb513fd052d0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:20.073527 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9c82acf0-4f9c-4805-9f73-bb513fd052d0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:20.074101 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9c82acf0-4f9c-4805-9f73-bb513fd052d0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:20.074606 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9c82acf0-4f9c-4805-9f73-bb513fd052d0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:20.075618 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9c82acf0-4f9c-4805-9f73-bb513fd052d0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:20.076180 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9c82acf0-4f9c-4805-9f73-bb513fd052d0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:20.076673 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9c82acf0-4f9c-4805-9f73-bb513fd052d0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:20.168484 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.objects.instance [None req-9c82acf0-4f9c-4805-9f73-bb513fd052d0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lazy-loading 'services' on Instance uuid 7761d354-80bf-44da-a290-3d35fa7a7a42 {{(pid=121211) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:39:20.430017 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-9c82acf0-4f9c-4805-9f73-bb513fd052d0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42/os-volume_attachments/55995236-9d60-4d62-af42-ccb429e4d695" status: 202 len: 0 microversion: 2.1 time: 0.368577 Sep 05 12:39:20.430657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 530/1042] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Sep 5 12:39:20 2022] DELETE /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42/os-volume_attachments/55995236-9d60-4d62-af42-ccb429e4d695 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:39:20.860711 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-8b07cbdb-c418-444b-9839-329c773add61 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:20.861241 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-8b07cbdb-c418-444b-9839-329c773add61 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 26d43048-46ef-4843-b1ba-6105a322c05f] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:20.867967 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8b07cbdb-c418-444b-9839-329c773add61 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:20.868449 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8b07cbdb-c418-444b-9839-329c773add61 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:20.868886 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8b07cbdb-c418-444b-9839-329c773add61 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:20.869578 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8b07cbdb-c418-444b-9839-329c773add61 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:20.870029 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8b07cbdb-c418-444b-9839-329c773add61 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:20.870446 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8b07cbdb-c418-444b-9839-329c773add61 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:20.884980 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-8b07cbdb-c418-444b-9839-329c773add61 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] HTTP exception thrown: Instance 26d43048-46ef-4843-b1ba-6105a322c05f could not be found. Sep 05 12:39:20.886631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-8b07cbdb-c418-444b-9839-329c773add61 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Request method failure captured: Sep 05 12:39:20.886631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f HTTP/1.1 Sep 05 12:39:20.886631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:39:20.886631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:39:20.886631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:39:20.886631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:39:20.886631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:39:20.886631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:39:20.886631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:39:20.886631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:39:20.886631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFewDRUV05d29SJp_G31-6mBsZ9vrlyQ_ZP_htmzZqW05aRJ8x0UJl1DbgzMId5vwgnTf00e5lTOuYpmtU2pf1kKQbzE5swJzwlzMbyqnAWcSSpyxbgM2DqTKhtSlsJgN5i9vSnt1JYNn_BxFT2cp1rIargJd3jzhO9xyzVV4vbTYvg8 Sep 05 12:39:20.886631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:39:20.886631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:39:20.886631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:39:20.886631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:39:20.886631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:39:20.886631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:39:20.886631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 4377cb4a93524abd99acb6ebe07fd1d6 Sep 05 12:39:20.886631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-TestVolumeBootPattern-294554139 Sep 05 12:39:20.886631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:39:20.886631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:39:20.888430 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4377cb4a93524abd99acb6ebe07fd1d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4377cb4a93524abd99acb6ebe07fd1d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4377cb4a93524abd99acb6ebe07fd1d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4377cb4a93524abd99acb6ebe07fd1d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:39:20.888430 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-TestVolumeBootPattern-294554139 Sep 05 12:39:20.888430 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 4377cb4a93524abd99acb6ebe07fd1d6 Sep 05 12:39:20.888430 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-TestVolumeBootPattern-294554139 Sep 05 12:39:20.888430 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-TestVolumeBootPattern-294554139-project Sep 05 12:39:20.888430 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:39:20.888430 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:39:20.888430 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: e7a29212dfae4a93beea7d11085cde63 Sep 05 12:39:20.888430 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-TestVolumeBootPattern-294554139-project Sep 05 12:39:20.888430 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:39:20.888430 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance 26d43048-46ef-4843-b1ba-6105a322c05f could not be found. Sep 05 12:39:20.888430 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': '26d43048-46ef-4843-b1ba-6105a322c05f'} Sep 05 12:39:20.889491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:39:20.889491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:39:20.889491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:39:20.889491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:39:20.889491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:39:20.889491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:39:20.889491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:39:20.889491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:39:20.889491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:39:20.889491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:39:20.889491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d43048-46ef-4843-b1ba-6105a322c05f could not be found. Sep 05 12:39:20.889491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:39:20.889491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:39:20.889491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:39:20.889491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:39:20.889491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:39:20.889491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:39:20.889491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:39:20.889491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:39:20.889491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:39:20.891063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:39:20.891063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:39:20.891063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:39:20.891063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:39:20.891063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:39:20.891063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:39:20.891063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:39:20.891063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d43048-46ef-4843-b1ba-6105a322c05f could not be found. Sep 05 12:39:20.891063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:39:20.891063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:39:20.891063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:39:20.891063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:39:20.891063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:39:20.891063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:39:20.891063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:39:20.891063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:39:20.891063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d43048-46ef-4843-b1ba-6105a322c05f could not be found. Sep 05 12:39:20.891063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:39:20.892641 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-8b07cbdb-c418-444b-9839-329c773add61 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Returning 404 to user: Instance 26d43048-46ef-4843-b1ba-6105a322c05f could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:39:20.892641 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-8b07cbdb-c418-444b-9839-329c773add61 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f" status: 404 len: 111 microversion: 2.1 time: 0.031836 Sep 05 12:39:20.892641 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 513/1043] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:20 2022] GET /compute/v2.1/servers/26d43048-46ef-4843-b1ba-6105a322c05f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:39:22.621242 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-dcdff6d6-a9dc-4e44-a9d2-5fcb10abadbf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:22.621827 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-dcdff6d6-a9dc-4e44-a9d2-5fcb10abadbf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:22.629062 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-dcdff6d6-a9dc-4e44-a9d2-5fcb10abadbf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:22.629546 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-dcdff6d6-a9dc-4e44-a9d2-5fcb10abadbf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:22.629986 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-dcdff6d6-a9dc-4e44-a9d2-5fcb10abadbf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:22.630703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-dcdff6d6-a9dc-4e44-a9d2-5fcb10abadbf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:22.631161 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-dcdff6d6-a9dc-4e44-a9d2-5fcb10abadbf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:22.631645 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-dcdff6d6-a9dc-4e44-a9d2-5fcb10abadbf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:22.657541 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-dcdff6d6-a9dc-4e44-a9d2-5fcb10abadbf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Going to try to terminate instance {{(pid=121211) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:39:22.951060 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-dcdff6d6-a9dc-4e44-a9d2-5fcb10abadbf tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42" status: 204 len: 0 microversion: 2.1 time: 0.334204 Sep 05 12:39:22.951985 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 531/1044] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:39:22 2022] DELETE /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:39:22.960027 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-14b29974-9ce8-472b-a872-702f59e77ac9 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:22.960677 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-14b29974-9ce8-472b-a872-702f59e77ac9 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:22.968023 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-14b29974-9ce8-472b-a872-702f59e77ac9 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:22.968482 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-14b29974-9ce8-472b-a872-702f59e77ac9 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:22.968937 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-14b29974-9ce8-472b-a872-702f59e77ac9 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:22.969634 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-14b29974-9ce8-472b-a872-702f59e77ac9 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:22.970087 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-14b29974-9ce8-472b-a872-702f59e77ac9 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:22.970498 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-14b29974-9ce8-472b-a872-702f59e77ac9 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:23.111636 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-14b29974-9ce8-472b-a872-702f59e77ac9 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:23.119927 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-14b29974-9ce8-472b-a872-702f59e77ac9 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42" status: 200 len: 1515 microversion: 2.1 time: 0.163590 Sep 05 12:39:23.120511 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 514/1045] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:22 2022] GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:24.145281 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-aa32795e-5480-4c94-a13f-c524e4bef5c3 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:24.146126 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-aa32795e-5480-4c94-a13f-c524e4bef5c3 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:24.152760 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa32795e-5480-4c94-a13f-c524e4bef5c3 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:24.153249 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa32795e-5480-4c94-a13f-c524e4bef5c3 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:24.153690 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa32795e-5480-4c94-a13f-c524e4bef5c3 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:24.154422 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa32795e-5480-4c94-a13f-c524e4bef5c3 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:24.154872 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa32795e-5480-4c94-a13f-c524e4bef5c3 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:24.155297 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa32795e-5480-4c94-a13f-c524e4bef5c3 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:24.348584 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d91eaacf-59d3-409d-b071-95a5e9646d88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:24.349287 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d91eaacf-59d3-409d-b071-95a5e9646d88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:24.356281 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d91eaacf-59d3-409d-b071-95a5e9646d88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:24.356853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d91eaacf-59d3-409d-b071-95a5e9646d88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:24.357879 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d91eaacf-59d3-409d-b071-95a5e9646d88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:24.358866 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d91eaacf-59d3-409d-b071-95a5e9646d88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:24.359722 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d91eaacf-59d3-409d-b071-95a5e9646d88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:24.360368 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d91eaacf-59d3-409d-b071-95a5e9646d88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:24.376997 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-aa32795e-5480-4c94-a13f-c524e4bef5c3 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:24.386026 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-aa32795e-5480-4c94-a13f-c524e4bef5c3 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42" status: 200 len: 1515 microversion: 2.1 time: 0.245389 Sep 05 12:39:24.386886 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 532/1046] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:24 2022] GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42 => generated 1515 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:24.391126 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d91eaacf-59d3-409d-b071-95a5e9646d88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Going to try to terminate instance {{(pid=121210) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:39:24.391909 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-7df82651-3d78-44b1-af0e-15b88349422d req-c87d79cb-252b-4e48-b0d2-b507a804b583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ca1300-109c-4625-a6f9-f7094055e384", "tag": "d439ecff-d56e-4259-b799-38d86dccd75f"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:39:24.401531 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-7df82651-3d78-44b1-af0e-15b88349422d req-c87d79cb-252b-4e48-b0d2-b507a804b583 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:24.402279 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-7df82651-3d78-44b1-af0e-15b88349422d req-c87d79cb-252b-4e48-b0d2-b507a804b583 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:24.402708 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-7df82651-3d78-44b1-af0e-15b88349422d req-c87d79cb-252b-4e48-b0d2-b507a804b583 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:24.413988 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-7df82651-3d78-44b1-af0e-15b88349422d req-c87d79cb-252b-4e48-b0d2-b507a804b583 service nova] Creating event network-changed:d439ecff-d56e-4259-b799-38d86dccd75f for instance 96ca1300-109c-4625-a6f9-f7094055e384 on hv-cinder-80135 Sep 05 12:39:24.419263 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-7df82651-3d78-44b1-af0e-15b88349422d req-c87d79cb-252b-4e48-b0d2-b507a804b583 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031059 Sep 05 12:39:24.420730 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 533/1047] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:39:24.733930 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d91eaacf-59d3-409d-b071-95a5e9646d88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "DELETE /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 204 len: 0 microversion: 2.1 time: 0.388269 Sep 05 12:39:24.735296 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 515/1048] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:39:24 2022] DELETE /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 05 12:39:24.744363 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-81781222-2d00-4f7c-b60c-ed8aab3d1b88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:24.745065 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-81781222-2d00-4f7c-b60c-ed8aab3d1b88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:24.752363 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-81781222-2d00-4f7c-b60c-ed8aab3d1b88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:24.752853 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-81781222-2d00-4f7c-b60c-ed8aab3d1b88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:24.753286 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-81781222-2d00-4f7c-b60c-ed8aab3d1b88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:24.753986 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-81781222-2d00-4f7c-b60c-ed8aab3d1b88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:24.754439 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-81781222-2d00-4f7c-b60c-ed8aab3d1b88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:24.754863 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-81781222-2d00-4f7c-b60c-ed8aab3d1b88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:24.899481 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-81781222-2d00-4f7c-b60c-ed8aab3d1b88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:24.915180 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-81781222-2d00-4f7c-b60c-ed8aab3d1b88 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1578 microversion: 2.1 time: 0.175050 Sep 05 12:39:24.916201 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 534/1049] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:24 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:25.410733 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-245745ae-0d03-4b8f-b11c-5228b1534ced tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:25.411430 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-245745ae-0d03-4b8f-b11c-5228b1534ced tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:25.418118 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-245745ae-0d03-4b8f-b11c-5228b1534ced tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:25.418527 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-245745ae-0d03-4b8f-b11c-5228b1534ced tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:25.418952 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-245745ae-0d03-4b8f-b11c-5228b1534ced tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:25.419688 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-245745ae-0d03-4b8f-b11c-5228b1534ced tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:25.420207 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-245745ae-0d03-4b8f-b11c-5228b1534ced tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:25.420676 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-245745ae-0d03-4b8f-b11c-5228b1534ced tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:25.455373 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e139644d-735b-444b-85aa-5b37decf30a7 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:25.455373 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e139644d-735b-444b-85aa-5b37decf30a7 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:25.461778 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e139644d-735b-444b-85aa-5b37decf30a7 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:25.462263 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e139644d-735b-444b-85aa-5b37decf30a7 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:25.462698 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e139644d-735b-444b-85aa-5b37decf30a7 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:25.463397 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e139644d-735b-444b-85aa-5b37decf30a7 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:25.463886 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e139644d-735b-444b-85aa-5b37decf30a7 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:25.464534 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e139644d-735b-444b-85aa-5b37decf30a7 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:25.551273 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.objects.instance [None req-e139644d-735b-444b-85aa-5b37decf30a7 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lazy-loading 'services' on Instance uuid d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 {{(pid=121211) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:39:25.561339 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-245745ae-0d03-4b8f-b11c-5228b1534ced tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:25.569267 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-245745ae-0d03-4b8f-b11c-5228b1534ced tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42" status: 200 len: 1515 microversion: 2.1 time: 0.162892 Sep 05 12:39:25.569840 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 516/1050] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:25 2022] GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:25.805080 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e139644d-735b-444b-85aa-5b37decf30a7 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14/os-volume_attachments/757c1209-fb7b-41af-abe0-f877b076fd62" status: 202 len: 0 microversion: 2.1 time: 0.355181 Sep 05 12:39:25.809711 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 535/1051] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Sep 5 12:39:25 2022] DELETE /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14/os-volume_attachments/757c1209-fb7b-41af-abe0-f877b076fd62 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 05 12:39:25.940536 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1abd3951-fea5-448d-9e43-f69e545661e8 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:25.941458 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1abd3951-fea5-448d-9e43-f69e545661e8 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:25.947482 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1abd3951-fea5-448d-9e43-f69e545661e8 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:25.948029 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1abd3951-fea5-448d-9e43-f69e545661e8 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:25.948465 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1abd3951-fea5-448d-9e43-f69e545661e8 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:25.949176 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1abd3951-fea5-448d-9e43-f69e545661e8 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:25.949629 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1abd3951-fea5-448d-9e43-f69e545661e8 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:25.950054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1abd3951-fea5-448d-9e43-f69e545661e8 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:26.088512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1abd3951-fea5-448d-9e43-f69e545661e8 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:26.097086 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1abd3951-fea5-448d-9e43-f69e545661e8 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1578 microversion: 2.1 time: 0.160424 Sep 05 12:39:26.097657 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 517/1052] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:25 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:26.594410 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-de7fe098-b58b-47f5-b8e2-9e285a7b64b5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:26.595022 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-de7fe098-b58b-47f5-b8e2-9e285a7b64b5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:26.601927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-de7fe098-b58b-47f5-b8e2-9e285a7b64b5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:26.602405 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-de7fe098-b58b-47f5-b8e2-9e285a7b64b5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:26.602832 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-de7fe098-b58b-47f5-b8e2-9e285a7b64b5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:26.603563 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-de7fe098-b58b-47f5-b8e2-9e285a7b64b5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:26.604012 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-de7fe098-b58b-47f5-b8e2-9e285a7b64b5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:26.604432 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-de7fe098-b58b-47f5-b8e2-9e285a7b64b5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:27.069502 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-de7fe098-b58b-47f5-b8e2-9e285a7b64b5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:27.078497 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-de7fe098-b58b-47f5-b8e2-9e285a7b64b5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42" status: 200 len: 1515 microversion: 2.1 time: 0.488978 Sep 05 12:39:27.079270 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 536/1053] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:26 2022] GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42 => generated 1515 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:27.121149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-81c5deed-a560-4b14-8946-5810bf4c2b3e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:27.121765 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-81c5deed-a560-4b14-8946-5810bf4c2b3e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:27.136441 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-81c5deed-a560-4b14-8946-5810bf4c2b3e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:27.136441 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-81c5deed-a560-4b14-8946-5810bf4c2b3e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:27.137080 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-81c5deed-a560-4b14-8946-5810bf4c2b3e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:27.137227 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-81c5deed-a560-4b14-8946-5810bf4c2b3e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:27.137685 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-81c5deed-a560-4b14-8946-5810bf4c2b3e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:27.138109 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-81c5deed-a560-4b14-8946-5810bf4c2b3e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:27.273752 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-81c5deed-a560-4b14-8946-5810bf4c2b3e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:27.281624 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-81c5deed-a560-4b14-8946-5810bf4c2b3e tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1578 microversion: 2.1 time: 0.164389 Sep 05 12:39:27.282212 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 518/1054] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:27 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:27.605652 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-d5b1182c-8145-4341-aba0-acaca34f34ef req-93774239-9217-4828-a3a6-f1fd53d0a2a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7761d354-80bf-44da-a290-3d35fa7a7a42", "name": "network-vif-deleted", "tag": "c2250e16-86aa-47dd-9cb2-2fac74ef3dd1"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:39:27.625169 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-d5b1182c-8145-4341-aba0-acaca34f34ef req-93774239-9217-4828-a3a6-f1fd53d0a2a3 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:27.625504 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-d5b1182c-8145-4341-aba0-acaca34f34ef req-93774239-9217-4828-a3a6-f1fd53d0a2a3 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:27.625935 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-d5b1182c-8145-4341-aba0-acaca34f34ef req-93774239-9217-4828-a3a6-f1fd53d0a2a3 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:27.657929 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-d5b1182c-8145-4341-aba0-acaca34f34ef req-93774239-9217-4828-a3a6-f1fd53d0a2a3 service nova] Creating event network-vif-deleted:c2250e16-86aa-47dd-9cb2-2fac74ef3dd1 for instance 7761d354-80bf-44da-a290-3d35fa7a7a42 on hv-cinder-80135 Sep 05 12:39:27.675689 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-d5b1182c-8145-4341-aba0-acaca34f34ef req-93774239-9217-4828-a3a6-f1fd53d0a2a3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073655 Sep 05 12:39:27.677052 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 537/1055] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:39:28.016510 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-f1e0aed2-f3f9-464c-be8d-60fbfb5964fe req-8d2d97bb-60e2-457a-9821-740d635a4523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ca1300-109c-4625-a6f9-f7094055e384", "name": "network-vif-deleted", "tag": "d439ecff-d56e-4259-b799-38d86dccd75f"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:39:28.022872 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-f1e0aed2-f3f9-464c-be8d-60fbfb5964fe req-8d2d97bb-60e2-457a-9821-740d635a4523 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:28.023345 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-f1e0aed2-f3f9-464c-be8d-60fbfb5964fe req-8d2d97bb-60e2-457a-9821-740d635a4523 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:28.023820 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-f1e0aed2-f3f9-464c-be8d-60fbfb5964fe req-8d2d97bb-60e2-457a-9821-740d635a4523 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:28.035926 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-f1e0aed2-f3f9-464c-be8d-60fbfb5964fe req-8d2d97bb-60e2-457a-9821-740d635a4523 service nova] Creating event network-vif-deleted:d439ecff-d56e-4259-b799-38d86dccd75f for instance 96ca1300-109c-4625-a6f9-f7094055e384 on hv-cinder-80135 Sep 05 12:39:28.040872 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-f1e0aed2-f3f9-464c-be8d-60fbfb5964fe req-8d2d97bb-60e2-457a-9821-740d635a4523 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031721 Sep 05 12:39:28.041494 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 519/1056] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:39:28.107099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-9eabddbb-0319-4fbf-93c4-8579bb75d538 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:28.107979 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-9eabddbb-0319-4fbf-93c4-8579bb75d538 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:28.114492 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9eabddbb-0319-4fbf-93c4-8579bb75d538 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:28.114981 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9eabddbb-0319-4fbf-93c4-8579bb75d538 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:28.115410 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9eabddbb-0319-4fbf-93c4-8579bb75d538 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:28.123175 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9eabddbb-0319-4fbf-93c4-8579bb75d538 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:28.123175 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9eabddbb-0319-4fbf-93c4-8579bb75d538 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:28.123175 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9eabddbb-0319-4fbf-93c4-8579bb75d538 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:28.203350 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-9eabddbb-0319-4fbf-93c4-8579bb75d538 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:28.214305 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-9eabddbb-0319-4fbf-93c4-8579bb75d538 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42" status: 200 len: 1304 microversion: 2.1 time: 0.111370 Sep 05 12:39:28.215201 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 538/1057] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:28 2022] GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:28.308798 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4e8cc876-9c92-4b8d-b4bf-5ced01d678f4 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:28.309811 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-4e8cc876-9c92-4b8d-b4bf-5ced01d678f4 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:28.317830 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4e8cc876-9c92-4b8d-b4bf-5ced01d678f4 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:28.318600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4e8cc876-9c92-4b8d-b4bf-5ced01d678f4 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:28.319049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4e8cc876-9c92-4b8d-b4bf-5ced01d678f4 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:28.319958 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4e8cc876-9c92-4b8d-b4bf-5ced01d678f4 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:28.320422 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4e8cc876-9c92-4b8d-b4bf-5ced01d678f4 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:28.320853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4e8cc876-9c92-4b8d-b4bf-5ced01d678f4 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:28.392837 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-4e8cc876-9c92-4b8d-b4bf-5ced01d678f4 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:28.405914 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-4e8cc876-9c92-4b8d-b4bf-5ced01d678f4 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1225 microversion: 2.1 time: 0.101769 Sep 05 12:39:28.406504 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 520/1058] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:28 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:29.091456 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a7a1a792-c616-4ae4-bf6d-89df5deae5a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:39:29.098642 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a7a1a792-c616-4ae4-bf6d-89df5deae5a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:29.099143 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a7a1a792-c616-4ae4-bf6d-89df5deae5a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:29.099627 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a7a1a792-c616-4ae4-bf6d-89df5deae5a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:29.123761 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a7a1a792-c616-4ae4-bf6d-89df5deae5a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Going to try to stop instance {{(pid=121211) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 05 12:39:29.238029 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a4b9aea1-d1b2-41c9-ad86-b92ef6981996 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:29.238651 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a4b9aea1-d1b2-41c9-ad86-b92ef6981996 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:29.244609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a4b9aea1-d1b2-41c9-ad86-b92ef6981996 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:29.245089 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a4b9aea1-d1b2-41c9-ad86-b92ef6981996 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:29.245523 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a4b9aea1-d1b2-41c9-ad86-b92ef6981996 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:29.246348 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a4b9aea1-d1b2-41c9-ad86-b92ef6981996 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:29.246803 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a4b9aea1-d1b2-41c9-ad86-b92ef6981996 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:29.247287 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a4b9aea1-d1b2-41c9-ad86-b92ef6981996 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:29.280778 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a4b9aea1-d1b2-41c9-ad86-b92ef6981996 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:29.281318 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a4b9aea1-d1b2-41c9-ad86-b92ef6981996 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:29.281754 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a4b9aea1-d1b2-41c9-ad86-b92ef6981996 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:29.282196 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-a4b9aea1-d1b2-41c9-ad86-b92ef6981996 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lazy-loading 'fault' on Instance uuid 7761d354-80bf-44da-a290-3d35fa7a7a42 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:39:29.340332 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a4b9aea1-d1b2-41c9-ad86-b92ef6981996 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:29.352465 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a4b9aea1-d1b2-41c9-ad86-b92ef6981996 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42" status: 200 len: 1309 microversion: 2.1 time: 0.113787 Sep 05 12:39:29.352465 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 521/1059] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:29 2022] GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42 => generated 1309 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:39:29.429177 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-6618b3f6-c4eb-4dd4-9de9-032b5f4d5ac6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:29.429789 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-6618b3f6-c4eb-4dd4-9de9-032b5f4d5ac6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:29.436108 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6618b3f6-c4eb-4dd4-9de9-032b5f4d5ac6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:29.436635 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6618b3f6-c4eb-4dd4-9de9-032b5f4d5ac6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:29.437070 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6618b3f6-c4eb-4dd4-9de9-032b5f4d5ac6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:29.437767 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6618b3f6-c4eb-4dd4-9de9-032b5f4d5ac6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:29.438218 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6618b3f6-c4eb-4dd4-9de9-032b5f4d5ac6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:29.438638 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6618b3f6-c4eb-4dd4-9de9-032b5f4d5ac6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:29.469249 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6618b3f6-c4eb-4dd4-9de9-032b5f4d5ac6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:29.469727 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6618b3f6-c4eb-4dd4-9de9-032b5f4d5ac6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:29.470157 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6618b3f6-c4eb-4dd4-9de9-032b5f4d5ac6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:29.470597 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-6618b3f6-c4eb-4dd4-9de9-032b5f4d5ac6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lazy-loading 'fault' on Instance uuid 96ca1300-109c-4625-a6f9-f7094055e384 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:39:29.513205 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6618b3f6-c4eb-4dd4-9de9-032b5f4d5ac6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a29212dfae4a93beea7d11085cde63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4377cb4a93524abd99acb6ebe07fd1d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:29.520983 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-6618b3f6-c4eb-4dd4-9de9-032b5f4d5ac6 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 200 len: 1230 microversion: 2.1 time: 0.095885 Sep 05 12:39:29.521548 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 522/1060] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:29 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:39:29.559665 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a7a1a792-c616-4ae4-bf6d-89df5deae5a0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "POST /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14/action" status: 202 len: 0 microversion: 2.1 time: 0.472330 Sep 05 12:39:29.560271 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 539/1061] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Sep 5 12:39:29 2022] POST /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:39:29.568385 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7a13c8a0-1ff9-4ed5-ac5e-8d8d6a7950a8 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:29.569004 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-7a13c8a0-1ff9-4ed5-ac5e-8d8d6a7950a8 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:29.575036 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7a13c8a0-1ff9-4ed5-ac5e-8d8d6a7950a8 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:29.575517 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7a13c8a0-1ff9-4ed5-ac5e-8d8d6a7950a8 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:29.575983 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7a13c8a0-1ff9-4ed5-ac5e-8d8d6a7950a8 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:29.577204 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7a13c8a0-1ff9-4ed5-ac5e-8d8d6a7950a8 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:29.577655 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7a13c8a0-1ff9-4ed5-ac5e-8d8d6a7950a8 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:29.578078 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7a13c8a0-1ff9-4ed5-ac5e-8d8d6a7950a8 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:29.582164 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:29.791257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-7a13c8a0-1ff9-4ed5-ac5e-8d8d6a7950a8 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:29.804373 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-7a13c8a0-1ff9-4ed5-ac5e-8d8d6a7950a8 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1678 microversion: 2.1 time: 0.239633 Sep 05 12:39:29.805318 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 523/1062] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:29 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:30.374572 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-b8f8c9c8-03d9-4512-9ee2-d03dee231a06 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:30.375265 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-b8f8c9c8-03d9-4512-9ee2-d03dee231a06 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 7761d354-80bf-44da-a290-3d35fa7a7a42] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:30.382080 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b8f8c9c8-03d9-4512-9ee2-d03dee231a06 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:30.382606 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b8f8c9c8-03d9-4512-9ee2-d03dee231a06 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:30.383037 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b8f8c9c8-03d9-4512-9ee2-d03dee231a06 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:30.383758 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b8f8c9c8-03d9-4512-9ee2-d03dee231a06 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:30.384208 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b8f8c9c8-03d9-4512-9ee2-d03dee231a06 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:30.384625 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b8f8c9c8-03d9-4512-9ee2-d03dee231a06 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:30.398359 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-b8f8c9c8-03d9-4512-9ee2-d03dee231a06 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] HTTP exception thrown: Instance 7761d354-80bf-44da-a290-3d35fa7a7a42 could not be found. Sep 05 12:39:30.400051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-b8f8c9c8-03d9-4512-9ee2-d03dee231a06 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Request method failure captured: Sep 05 12:39:30.400051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42 HTTP/1.1 Sep 05 12:39:30.400051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:39:30.400051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:39:30.400051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:39:30.400051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:39:30.400051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:39:30.400051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:39:30.400051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:39:30.400051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:39:30.400051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFe29pEuL4a2dmBrOtHUEaF2yg1QiMQGJL8fTSMgigeKMpg2U8Cxa8f-rcd3OvIZM5WOWm1k-1dgkIILVTHilDMrB9ZGP665ZGx1v4UHxShuqlKdYVog8hmiCTWS6nSDu7vxKxAyJvAsbQIMx-dXswHmWg4m2kuY39WIkFew54AtrfU0 Sep 05 12:39:30.400051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:39:30.400051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:39:30.400051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:39:30.400051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:39:30.400051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:39:30.400051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:39:30.400051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 2a77deb0bf54420e90c26e66699b3611 Sep 05 12:39:30.400051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1467014265 Sep 05 12:39:30.400051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:39:30.400051 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:39:30.401806 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2a77deb0bf54420e90c26e66699b3611"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2a77deb0bf54420e90c26e66699b3611"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2a77deb0bf54420e90c26e66699b3611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2a77deb0bf54420e90c26e66699b3611"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:39:30.401806 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-VolumesSnapshotTestJSON-1467014265 Sep 05 12:39:30.401806 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 2a77deb0bf54420e90c26e66699b3611 Sep 05 12:39:30.401806 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1467014265 Sep 05 12:39:30.401806 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-VolumesSnapshotTestJSON-1467014265-project Sep 05 12:39:30.401806 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:39:30.401806 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:39:30.401806 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: 6c22d28f87c941afb1fad1cfaf3a5fb2 Sep 05 12:39:30.401806 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-VolumesSnapshotTestJSON-1467014265-project Sep 05 12:39:30.401806 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: > Sep 05 12:39:30.401806 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Instance 7761d354-80bf-44da-a290-3d35fa7a7a42 could not be found. Sep 05 12:39:30.401806 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': '7761d354-80bf-44da-a290-3d35fa7a7a42'} Sep 05 12:39:30.402994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:39:30.402994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:39:30.402994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:39:30.402994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:39:30.402994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:39:30.402994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:39:30.402994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:39:30.402994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:39:30.402994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:39:30.402994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:39:30.402994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7761d354-80bf-44da-a290-3d35fa7a7a42 could not be found. Sep 05 12:39:30.402994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:39:30.402994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:39:30.402994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:39:30.402994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:39:30.402994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:39:30.402994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:39:30.402994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:39:30.402994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:39:30.402994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:39:30.404626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:39:30.404626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:39:30.404626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:39:30.404626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:39:30.404626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:39:30.404626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:39:30.404626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:39:30.404626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7761d354-80bf-44da-a290-3d35fa7a7a42 could not be found. Sep 05 12:39:30.404626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:39:30.404626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:39:30.404626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:39:30.404626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:39:30.404626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:39:30.404626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:39:30.404626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:39:30.404626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:39:30.404626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7761d354-80bf-44da-a290-3d35fa7a7a42 could not be found. Sep 05 12:39:30.404626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:39:30.405981 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-b8f8c9c8-03d9-4512-9ee2-d03dee231a06 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Returning 404 to user: Instance 7761d354-80bf-44da-a290-3d35fa7a7a42 could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:39:30.405981 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-b8f8c9c8-03d9-4512-9ee2-d03dee231a06 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42" status: 404 len: 111 microversion: 2.1 time: 0.032203 Sep 05 12:39:30.405981 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 540/1063] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:30 2022] GET /compute/v2.1/servers/7761d354-80bf-44da-a290-3d35fa7a7a42 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:39:30.545912 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-8e517fb2-8704-48df-bfd1-f5b4adcd8d50 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:30.546558 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-8e517fb2-8704-48df-bfd1-f5b4adcd8d50 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: 96ca1300-109c-4625-a6f9-f7094055e384] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:30.553310 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8e517fb2-8704-48df-bfd1-f5b4adcd8d50 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:30.553797 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8e517fb2-8704-48df-bfd1-f5b4adcd8d50 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:30.554221 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8e517fb2-8704-48df-bfd1-f5b4adcd8d50 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:30.554920 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8e517fb2-8704-48df-bfd1-f5b4adcd8d50 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:30.555492 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8e517fb2-8704-48df-bfd1-f5b4adcd8d50 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:30.555936 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8e517fb2-8704-48df-bfd1-f5b4adcd8d50 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:30.571193 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-8e517fb2-8704-48df-bfd1-f5b4adcd8d50 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] HTTP exception thrown: Instance 96ca1300-109c-4625-a6f9-f7094055e384 could not be found. Sep 05 12:39:30.572882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-8e517fb2-8704-48df-bfd1-f5b4adcd8d50 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Request method failure captured: Sep 05 12:39:30.572882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 HTTP/1.1 Sep 05 12:39:30.572882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:39:30.572882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:39:30.572882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:39:30.572882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:39:30.572882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:39:30.572882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:39:30.572882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:39:30.572882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:39:30.572882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFewDRUV05d29SJp_G31-6mBsZ9vrlyQ_ZP_htmzZqW05aRJ8x0UJl1DbgzMId5vwgnTf00e5lTOuYpmtU2pf1kKQbzE5swJzwlzMbyqnAWcSSpyxbgM2DqTKhtSlsJgN5i9vSnt1JYNn_BxFT2cp1rIargJd3jzhO9xyzVV4vbTYvg8 Sep 05 12:39:30.572882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:39:30.572882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:39:30.572882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:39:30.572882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:39:30.572882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:39:30.572882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:39:30.572882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 4377cb4a93524abd99acb6ebe07fd1d6 Sep 05 12:39:30.572882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-TestVolumeBootPattern-294554139 Sep 05 12:39:30.572882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:39:30.572882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:39:30.574348 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4377cb4a93524abd99acb6ebe07fd1d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4377cb4a93524abd99acb6ebe07fd1d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4377cb4a93524abd99acb6ebe07fd1d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4377cb4a93524abd99acb6ebe07fd1d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:39:30.574348 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-TestVolumeBootPattern-294554139 Sep 05 12:39:30.574348 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 4377cb4a93524abd99acb6ebe07fd1d6 Sep 05 12:39:30.574348 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-TestVolumeBootPattern-294554139 Sep 05 12:39:30.574348 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-TestVolumeBootPattern-294554139-project Sep 05 12:39:30.574348 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:39:30.574348 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:39:30.574348 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: e7a29212dfae4a93beea7d11085cde63 Sep 05 12:39:30.574348 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-TestVolumeBootPattern-294554139-project Sep 05 12:39:30.574348 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:39:30.574348 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance 96ca1300-109c-4625-a6f9-f7094055e384 could not be found. Sep 05 12:39:30.574348 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': '96ca1300-109c-4625-a6f9-f7094055e384'} Sep 05 12:39:30.575188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:39:30.575188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:39:30.575188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:39:30.575188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:39:30.575188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:39:30.575188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:39:30.575188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:39:30.575188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:39:30.575188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:39:30.575188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:39:30.575188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96ca1300-109c-4625-a6f9-f7094055e384 could not be found. Sep 05 12:39:30.575188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:39:30.575188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:39:30.575188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:39:30.575188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:39:30.575188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:39:30.575188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:39:30.575188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:39:30.575188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:39:30.575188 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:39:30.576501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:39:30.576501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:39:30.576501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:39:30.576501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:39:30.576501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:39:30.576501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:39:30.576501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:39:30.576501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96ca1300-109c-4625-a6f9-f7094055e384 could not be found. Sep 05 12:39:30.576501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:39:30.576501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:39:30.576501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:39:30.576501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:39:30.576501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:39:30.576501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:39:30.576501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:39:30.576501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:39:30.576501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96ca1300-109c-4625-a6f9-f7094055e384 could not be found. Sep 05 12:39:30.576501 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:39:30.577688 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-8e517fb2-8704-48df-bfd1-f5b4adcd8d50 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Returning 404 to user: Instance 96ca1300-109c-4625-a6f9-f7094055e384 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:39:30.577688 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-8e517fb2-8704-48df-bfd1-f5b4adcd8d50 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384" status: 404 len: 111 microversion: 2.1 time: 0.033618 Sep 05 12:39:30.577688 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 524/1064] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:30 2022] GET /compute/v2.1/servers/96ca1300-109c-4625-a6f9-f7094055e384 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:39:30.828303 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-902652eb-d257-4eb1-973a-b5aaca20f46c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:30.828887 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-902652eb-d257-4eb1-973a-b5aaca20f46c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:30.841072 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-902652eb-d257-4eb1-973a-b5aaca20f46c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:30.841557 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-902652eb-d257-4eb1-973a-b5aaca20f46c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:30.842481 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-902652eb-d257-4eb1-973a-b5aaca20f46c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:30.843185 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-902652eb-d257-4eb1-973a-b5aaca20f46c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:30.843792 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-902652eb-d257-4eb1-973a-b5aaca20f46c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:30.844225 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-902652eb-d257-4eb1-973a-b5aaca20f46c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:30.848745 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:30.981839 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-902652eb-d257-4eb1-973a-b5aaca20f46c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:30.990287 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-902652eb-d257-4eb1-973a-b5aaca20f46c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1678 microversion: 2.1 time: 0.165855 Sep 05 12:39:30.990866 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 541/1065] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:30 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:31.148878 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-3b821fdc-1eec-46b9-a4c6-a278ff0a7f34 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:31.153527 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-3b821fdc-1eec-46b9-a4c6-a278ff0a7f34 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:31.156577 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3b821fdc-1eec-46b9-a4c6-a278ff0a7f34 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:31.157063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3b821fdc-1eec-46b9-a4c6-a278ff0a7f34 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:31.157659 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3b821fdc-1eec-46b9-a4c6-a278ff0a7f34 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:31.158366 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3b821fdc-1eec-46b9-a4c6-a278ff0a7f34 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:31.158816 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3b821fdc-1eec-46b9-a4c6-a278ff0a7f34 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:31.159409 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3b821fdc-1eec-46b9-a4c6-a278ff0a7f34 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:31.176050 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-3b821fdc-1eec-46b9-a4c6-a278ff0a7f34 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] HTTP exception thrown: Instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 could not be found. Sep 05 12:39:31.177608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-3b821fdc-1eec-46b9-a4c6-a278ff0a7f34 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Request method failure captured: Sep 05 12:39:31.177608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: DELETE /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 HTTP/1.1 Sep 05 12:39:31.177608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:39:31.177608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:39:31.177608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:39:31.177608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:39:31.177608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:39:31.177608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:39:31.177608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:39:31.177608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:39:31.177608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFewDRUV05d29SJp_G31-6mBsZ9vrlyQ_ZP_htmzZqW05aRJ8x0UJl1DbgzMId5vwgnTf00e5lTOuYpmtU2pf1kKQbzE5swJzwlzMbyqnAWcSSpyxbgM2DqTKhtSlsJgN5i9vSnt1JYNn_BxFT2cp1rIargJd3jzhO9xyzVV4vbTYvg8 Sep 05 12:39:31.177608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:39:31.177608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:39:31.177608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:39:31.177608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:39:31.177608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:39:31.177608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:39:31.177608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 4377cb4a93524abd99acb6ebe07fd1d6 Sep 05 12:39:31.177608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-TestVolumeBootPattern-294554139 Sep 05 12:39:31.177608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:39:31.177608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:39:31.179291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4377cb4a93524abd99acb6ebe07fd1d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4377cb4a93524abd99acb6ebe07fd1d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4377cb4a93524abd99acb6ebe07fd1d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4377cb4a93524abd99acb6ebe07fd1d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:39:31.179291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-TestVolumeBootPattern-294554139 Sep 05 12:39:31.179291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 4377cb4a93524abd99acb6ebe07fd1d6 Sep 05 12:39:31.179291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-TestVolumeBootPattern-294554139 Sep 05 12:39:31.179291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-TestVolumeBootPattern-294554139-project Sep 05 12:39:31.179291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:39:31.179291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:39:31.179291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: e7a29212dfae4a93beea7d11085cde63 Sep 05 12:39:31.179291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-TestVolumeBootPattern-294554139-project Sep 05 12:39:31.179291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:39:31.179291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 could not be found. Sep 05 12:39:31.179291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': 'ee288301-eeb1-4e09-8a2c-d9bc6c00d914'} Sep 05 12:39:31.180327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:39:31.180327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:39:31.180327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:39:31.180327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:39:31.180327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:39:31.180327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:39:31.180327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:39:31.180327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:39:31.180327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:39:31.180327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:39:31.180327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 could not be found. Sep 05 12:39:31.180327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:39:31.180327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:39:31.180327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:39:31.180327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:39:31.180327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:39:31.180327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:39:31.180327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:39:31.180327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:39:31.180327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:39:31.181856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:39:31.181856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 12:39:31.181856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 12:39:31.181856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 12:39:31.181856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 12:39:31.181856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:39:31.181856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:39:31.181856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:39:31.181856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:39:31.181856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 could not be found. Sep 05 12:39:31.181856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:39:31.181856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:39:31.181856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:39:31.181856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:39:31.181856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:39:31.181856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:39:31.181856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:39:31.181856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:39:31.181856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 could not be found. Sep 05 12:39:31.181856 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:39:31.183336 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-3b821fdc-1eec-46b9-a4c6-a278ff0a7f34 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Returning 404 to user: Instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:39:31.183336 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-3b821fdc-1eec-46b9-a4c6-a278ff0a7f34 tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 404 len: 111 microversion: 2.1 time: 0.034113 Sep 05 12:39:31.183336 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 525/1066] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:39:31 2022] DELETE /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:39:31.188406 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-bab09a50-178a-49de-af3b-7242578f98dd tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:31.189016 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-bab09a50-178a-49de-af3b-7242578f98dd tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [instance: ee288301-eeb1-4e09-8a2c-d9bc6c00d914] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:31.195455 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bab09a50-178a-49de-af3b-7242578f98dd tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:31.196386 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bab09a50-178a-49de-af3b-7242578f98dd tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:31.196827 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bab09a50-178a-49de-af3b-7242578f98dd tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:31.197566 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bab09a50-178a-49de-af3b-7242578f98dd tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:31.198017 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bab09a50-178a-49de-af3b-7242578f98dd tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:31.198443 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bab09a50-178a-49de-af3b-7242578f98dd tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:31.212981 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-bab09a50-178a-49de-af3b-7242578f98dd tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] HTTP exception thrown: Instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 could not be found. Sep 05 12:39:31.214516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-bab09a50-178a-49de-af3b-7242578f98dd tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Request method failure captured: Sep 05 12:39:31.214516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 HTTP/1.1 Sep 05 12:39:31.214516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:39:31.214516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:39:31.214516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:39:31.214516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:39:31.214516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:39:31.214516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:39:31.214516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:39:31.214516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:39:31.214516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFewDRUV05d29SJp_G31-6mBsZ9vrlyQ_ZP_htmzZqW05aRJ8x0UJl1DbgzMId5vwgnTf00e5lTOuYpmtU2pf1kKQbzE5swJzwlzMbyqnAWcSSpyxbgM2DqTKhtSlsJgN5i9vSnt1JYNn_BxFT2cp1rIargJd3jzhO9xyzVV4vbTYvg8 Sep 05 12:39:31.214516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:39:31.214516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:39:31.214516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:39:31.214516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:39:31.214516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:39:31.214516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:39:31.214516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 4377cb4a93524abd99acb6ebe07fd1d6 Sep 05 12:39:31.214516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-TestVolumeBootPattern-294554139 Sep 05 12:39:31.214516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:39:31.214516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:39:31.216162 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4377cb4a93524abd99acb6ebe07fd1d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4377cb4a93524abd99acb6ebe07fd1d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4377cb4a93524abd99acb6ebe07fd1d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4377cb4a93524abd99acb6ebe07fd1d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:39:31.216162 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-TestVolumeBootPattern-294554139 Sep 05 12:39:31.216162 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 4377cb4a93524abd99acb6ebe07fd1d6 Sep 05 12:39:31.216162 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-TestVolumeBootPattern-294554139 Sep 05 12:39:31.216162 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-TestVolumeBootPattern-294554139-project Sep 05 12:39:31.216162 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:39:31.216162 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:39:31.216162 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: e7a29212dfae4a93beea7d11085cde63 Sep 05 12:39:31.216162 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-TestVolumeBootPattern-294554139-project Sep 05 12:39:31.216162 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: > Sep 05 12:39:31.216162 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 could not be found. Sep 05 12:39:31.216162 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': 'ee288301-eeb1-4e09-8a2c-d9bc6c00d914'} Sep 05 12:39:31.216989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:39:31.216989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:39:31.216989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:39:31.216989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:39:31.216989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:39:31.216989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:39:31.216989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:39:31.216989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:39:31.216989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:39:31.216989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:39:31.216989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 could not be found. Sep 05 12:39:31.216989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:39:31.216989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:39:31.216989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:39:31.216989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:39:31.216989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:39:31.216989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:39:31.216989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:39:31.216989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:39:31.216989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:39:31.218245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:39:31.218245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:39:31.218245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:39:31.218245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:39:31.218245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:39:31.218245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:39:31.218245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:39:31.218245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 could not be found. Sep 05 12:39:31.218245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:39:31.218245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:39:31.218245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:39:31.218245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:39:31.218245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:39:31.218245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:39:31.218245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:39:31.218245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:39:31.218245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 could not be found. Sep 05 12:39:31.218245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:39:31.219372 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-bab09a50-178a-49de-af3b-7242578f98dd tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Returning 404 to user: Instance ee288301-eeb1-4e09-8a2c-d9bc6c00d914 could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:39:31.219372 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-bab09a50-178a-49de-af3b-7242578f98dd tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914" status: 404 len: 111 microversion: 2.1 time: 0.031852 Sep 05 12:39:31.219372 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 542/1067] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:31 2022] GET /compute/v2.1/servers/ee288301-eeb1-4e09-8a2c-d9bc6c00d914 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 05 12:39:32.014921 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d277cfcf-705a-4d5d-80d7-4dd4c36efcb3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:32.015518 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d277cfcf-705a-4d5d-80d7-4dd4c36efcb3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:32.023074 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d277cfcf-705a-4d5d-80d7-4dd4c36efcb3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:32.023579 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d277cfcf-705a-4d5d-80d7-4dd4c36efcb3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:32.024008 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d277cfcf-705a-4d5d-80d7-4dd4c36efcb3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:32.024701 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d277cfcf-705a-4d5d-80d7-4dd4c36efcb3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:32.025148 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d277cfcf-705a-4d5d-80d7-4dd4c36efcb3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:32.025561 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d277cfcf-705a-4d5d-80d7-4dd4c36efcb3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:32.171717 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d277cfcf-705a-4d5d-80d7-4dd4c36efcb3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:32.179582 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d277cfcf-705a-4d5d-80d7-4dd4c36efcb3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1678 microversion: 2.1 time: 0.168658 Sep 05 12:39:32.180155 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 526/1068] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:32 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:33.203304 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4db19c13-d28f-40db-81a9-d020e985e14d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:33.203890 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4db19c13-d28f-40db-81a9-d020e985e14d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:33.210589 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4db19c13-d28f-40db-81a9-d020e985e14d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:33.211071 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4db19c13-d28f-40db-81a9-d020e985e14d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:33.211503 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4db19c13-d28f-40db-81a9-d020e985e14d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:33.212272 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4db19c13-d28f-40db-81a9-d020e985e14d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:33.212850 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4db19c13-d28f-40db-81a9-d020e985e14d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:33.213328 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4db19c13-d28f-40db-81a9-d020e985e14d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:33.342567 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-4db19c13-d28f-40db-81a9-d020e985e14d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:33.350180 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4db19c13-d28f-40db-81a9-d020e985e14d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1678 microversion: 2.1 time: 0.151949 Sep 05 12:39:33.350737 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 543/1069] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:33 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:34.379639 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-bc4a5d57-210e-47cf-96f7-83fe4d005153 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:34.380204 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-bc4a5d57-210e-47cf-96f7-83fe4d005153 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:34.386647 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bc4a5d57-210e-47cf-96f7-83fe4d005153 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:34.388525 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bc4a5d57-210e-47cf-96f7-83fe4d005153 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:34.388525 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bc4a5d57-210e-47cf-96f7-83fe4d005153 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:34.388525 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bc4a5d57-210e-47cf-96f7-83fe4d005153 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:34.388935 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bc4a5d57-210e-47cf-96f7-83fe4d005153 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:34.389117 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bc4a5d57-210e-47cf-96f7-83fe4d005153 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:34.526772 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-bc4a5d57-210e-47cf-96f7-83fe4d005153 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:34.531332 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-bc4a5d57-210e-47cf-96f7-83fe4d005153 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1678 microversion: 2.1 time: 0.155977 Sep 05 12:39:34.531959 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 527/1070] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:34 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:34.856397 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-032b7911-deb8-46c2-b3a2-365e099d0abb tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] Calling method '.version_select at 0x7fe7129564c0>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:34.861198 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR oslo.messaging._drivers.impl_rabbit [None req-032b7911-deb8-46c2-b3a2-365e099d0abb tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [a80ebc14-9bc0-4280-85d6-ac5ccdf4c268] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 05 12:39:35.559049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-77bbe01e-f6e7-40d6-bf27-f9eef30d640b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:35.559607 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-77bbe01e-f6e7-40d6-bf27-f9eef30d640b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:35.566786 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-77bbe01e-f6e7-40d6-bf27-f9eef30d640b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:35.567276 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-77bbe01e-f6e7-40d6-bf27-f9eef30d640b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:35.567738 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-77bbe01e-f6e7-40d6-bf27-f9eef30d640b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:35.568447 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-77bbe01e-f6e7-40d6-bf27-f9eef30d640b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:35.568903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-77bbe01e-f6e7-40d6-bf27-f9eef30d640b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:35.569332 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-77bbe01e-f6e7-40d6-bf27-f9eef30d640b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:35.707166 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-77bbe01e-f6e7-40d6-bf27-f9eef30d640b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:35.715163 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-77bbe01e-f6e7-40d6-bf27-f9eef30d640b tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1678 microversion: 2.1 time: 0.162762 Sep 05 12:39:35.715780 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 528/1071] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:35 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:35.869020 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO oslo.messaging._drivers.impl_rabbit [None req-032b7911-deb8-46c2-b3a2-365e099d0abb tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] [a80ebc14-9bc0-4280-85d6-ac5ccdf4c268] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 44344. Sep 05 12:39:35.941216 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-032b7911-deb8-46c2-b3a2-365e099d0abb tempest-TestVolumeBootPattern-294554139 tempest-TestVolumeBootPattern-294554139-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-384624755" status: 202 len: 0 microversion: 2.1 time: 1.088887 Sep 05 12:39:35.941814 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 544/1072] 10.222.0.62 () {58 vars in 1260 bytes} [Mon Sep 5 12:39:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-384624755 => generated 0 bytes in 1090 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:39:36.747250 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-9a80d5ba-4bf5-4359-97a3-c01095735a70 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:36.747250 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-9a80d5ba-4bf5-4359-97a3-c01095735a70 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:36.749438 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9a80d5ba-4bf5-4359-97a3-c01095735a70 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:36.749941 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9a80d5ba-4bf5-4359-97a3-c01095735a70 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:36.750382 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9a80d5ba-4bf5-4359-97a3-c01095735a70 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:36.751099 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9a80d5ba-4bf5-4359-97a3-c01095735a70 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:36.751574 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9a80d5ba-4bf5-4359-97a3-c01095735a70 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:36.752259 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9a80d5ba-4bf5-4359-97a3-c01095735a70 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:36.994755 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-9a80d5ba-4bf5-4359-97a3-c01095735a70 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:37.003107 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-9a80d5ba-4bf5-4359-97a3-c01095735a70 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1678 microversion: 2.1 time: 0.267318 Sep 05 12:39:37.003751 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 529/1073] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:36 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1678 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:38.027306 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-180e9052-6a69-4e70-b175-041649b73fc6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:38.028251 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-180e9052-6a69-4e70-b175-041649b73fc6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:38.035523 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-180e9052-6a69-4e70-b175-041649b73fc6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:38.036196 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-180e9052-6a69-4e70-b175-041649b73fc6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:38.036740 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-180e9052-6a69-4e70-b175-041649b73fc6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:38.037572 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-180e9052-6a69-4e70-b175-041649b73fc6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:38.038159 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-180e9052-6a69-4e70-b175-041649b73fc6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:38.038686 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-180e9052-6a69-4e70-b175-041649b73fc6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:38.182324 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-180e9052-6a69-4e70-b175-041649b73fc6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:38.191995 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-180e9052-6a69-4e70-b175-041649b73fc6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1678 microversion: 2.1 time: 0.169520 Sep 05 12:39:38.192579 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 545/1074] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:38 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:39.216694 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ee3e16e3-c3a9-4f43-a843-71a562a1daef tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:39.219127 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-ee3e16e3-c3a9-4f43-a843-71a562a1daef tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:39.224391 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ee3e16e3-c3a9-4f43-a843-71a562a1daef tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:39.224869 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ee3e16e3-c3a9-4f43-a843-71a562a1daef tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:39.225297 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ee3e16e3-c3a9-4f43-a843-71a562a1daef tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:39.226003 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ee3e16e3-c3a9-4f43-a843-71a562a1daef tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:39.226453 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ee3e16e3-c3a9-4f43-a843-71a562a1daef tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:39.226868 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ee3e16e3-c3a9-4f43-a843-71a562a1daef tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:39.407964 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-ee3e16e3-c3a9-4f43-a843-71a562a1daef tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:39.419030 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-ee3e16e3-c3a9-4f43-a843-71a562a1daef tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1678 microversion: 2.1 time: 0.205735 Sep 05 12:39:39.434035 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 530/1075] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:39 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1678 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:40.443082 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1e1dc9f3-1986-4739-9008-c4d51033d903 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:40.443757 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1e1dc9f3-1986-4739-9008-c4d51033d903 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:40.450379 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1e1dc9f3-1986-4739-9008-c4d51033d903 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:40.450945 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1e1dc9f3-1986-4739-9008-c4d51033d903 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:40.452049 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1e1dc9f3-1986-4739-9008-c4d51033d903 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:40.452762 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1e1dc9f3-1986-4739-9008-c4d51033d903 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:40.453217 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1e1dc9f3-1986-4739-9008-c4d51033d903 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:40.453959 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1e1dc9f3-1986-4739-9008-c4d51033d903 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:40.597722 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1e1dc9f3-1986-4739-9008-c4d51033d903 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:40.605933 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1e1dc9f3-1986-4739-9008-c4d51033d903 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1678 microversion: 2.1 time: 0.167033 Sep 05 12:39:40.608671 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 546/1076] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:40 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:40.961834 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-6045abe6-3d7d-4142-a940-aeaed75392c5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1577669774", "imageRef": "7844cf5b-4975-4cb9-a7f8-31cc5e52098a", "flavorRef": "452", "networks": [{"uuid": "940f936d-c824-4ec4-900c-187414e9e41b"}]}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:39:41.017345 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.network.neutron [None req-6045abe6-3d7d-4142-a940-aeaed75392c5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] validate_networks() for [('940f936d-c824-4ec4-900c-187414e9e41b', None, None, None, None, None)] {{(pid=121210) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:39:41.392864 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 12:39:41.393084 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Mon Sep 5 12:39:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.62) !!! Sep 05 12:39:41.630114 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-bf2b6ded-3551-4c05-ac37-cbf4a4ac061e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:41.630735 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-bf2b6ded-3551-4c05-ac37-cbf4a4ac061e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:41.637592 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bf2b6ded-3551-4c05-ac37-cbf4a4ac061e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:41.638141 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bf2b6ded-3551-4c05-ac37-cbf4a4ac061e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:41.638585 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bf2b6ded-3551-4c05-ac37-cbf4a4ac061e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:41.639813 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bf2b6ded-3551-4c05-ac37-cbf4a4ac061e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:41.640273 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bf2b6ded-3551-4c05-ac37-cbf4a4ac061e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:41.640708 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bf2b6ded-3551-4c05-ac37-cbf4a4ac061e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:41.778245 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-bf2b6ded-3551-4c05-ac37-cbf4a4ac061e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:41.785080 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-bf2b6ded-3551-4c05-ac37-cbf4a4ac061e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1678 microversion: 2.1 time: 0.159311 Sep 05 12:39:41.785671 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 547/1077] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:41 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:39:41.914116 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-6045abe6-3d7d-4142-a940-aeaed75392c5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Flavor limits 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:39:41.914544 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-6045abe6-3d7d-4142-a940-aeaed75392c5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Image limits 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:39:41.915018 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-6045abe6-3d7d-4142-a940-aeaed75392c5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Flavor pref 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:39:41.915428 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-6045abe6-3d7d-4142-a940-aeaed75392c5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Image pref 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:39:41.915869 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-6045abe6-3d7d-4142-a940-aeaed75392c5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:39:41.925675 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6045abe6-3d7d-4142-a940-aeaed75392c5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:41.926163 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6045abe6-3d7d-4142-a940-aeaed75392c5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:41.926603 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6045abe6-3d7d-4142-a940-aeaed75392c5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:41.927329 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6045abe6-3d7d-4142-a940-aeaed75392c5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:41.927809 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6045abe6-3d7d-4142-a940-aeaed75392c5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:41.928242 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6045abe6-3d7d-4142-a940-aeaed75392c5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:41.948458 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-6045abe6-3d7d-4142-a940-aeaed75392c5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Getting quotas for project 2a77deb0bf54420e90c26e66699b3611. Resources: {'ram', 'instances', 'cores'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:39:41.952456 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-6045abe6-3d7d-4142-a940-aeaed75392c5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Getting quotas for user 6c22d28f87c941afb1fad1cfaf3a5fb2 and project 2a77deb0bf54420e90c26e66699b3611. Resources: {'ram', 'instances', 'cores'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:39:41.963993 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-6045abe6-3d7d-4142-a940-aeaed75392c5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Going to run 1 instances... {{(pid=121210) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:39:41.966299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-6045abe6-3d7d-4142-a940-aeaed75392c5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7844cf5b-4975-4cb9-a7f8-31cc5e52098a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:39:42.104125 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-6045abe6-3d7d-4142-a940-aeaed75392c5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.146262 Sep 05 12:39:42.104942 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 531/1078] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Sep 5 12:39:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:39:42.116748 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c7cb91f8-8218-42f6-9f86-70db5666f0e8 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:42.117366 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-c7cb91f8-8218-42f6-9f86-70db5666f0e8 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:42.190572 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c7cb91f8-8218-42f6-9f86-70db5666f0e8 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:42.198454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-c7cb91f8-8218-42f6-9f86-70db5666f0e8 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123" status: 200 len: 1219 microversion: 2.1 time: 0.085491 Sep 05 12:39:42.199431 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 548/1079] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:42 2022] GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:42.809950 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1966e82d-f626-41df-935b-5d51b781931a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:42.810487 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1966e82d-f626-41df-935b-5d51b781931a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:42.816747 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1966e82d-f626-41df-935b-5d51b781931a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:42.817266 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1966e82d-f626-41df-935b-5d51b781931a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:42.817700 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1966e82d-f626-41df-935b-5d51b781931a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:42.826759 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1966e82d-f626-41df-935b-5d51b781931a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:42.826759 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1966e82d-f626-41df-935b-5d51b781931a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:42.826759 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1966e82d-f626-41df-935b-5d51b781931a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:43.040262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1966e82d-f626-41df-935b-5d51b781931a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:43.050970 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1966e82d-f626-41df-935b-5d51b781931a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1678 microversion: 2.1 time: 0.245006 Sep 05 12:39:43.052012 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 532/1080] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:42 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1678 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:43.221633 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8cdc6e23-bce3-4ed9-9973-8d829b1bda0e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:43.222281 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-8cdc6e23-bce3-4ed9-9973-8d829b1bda0e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:43.228789 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8cdc6e23-bce3-4ed9-9973-8d829b1bda0e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:43.229270 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8cdc6e23-bce3-4ed9-9973-8d829b1bda0e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:43.229707 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8cdc6e23-bce3-4ed9-9973-8d829b1bda0e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:43.230404 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8cdc6e23-bce3-4ed9-9973-8d829b1bda0e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:43.230859 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8cdc6e23-bce3-4ed9-9973-8d829b1bda0e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:43.231288 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8cdc6e23-bce3-4ed9-9973-8d829b1bda0e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:43.293137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-8cdc6e23-bce3-4ed9-9973-8d829b1bda0e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:43.301864 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-8cdc6e23-bce3-4ed9-9973-8d829b1bda0e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123" status: 200 len: 1223 microversion: 2.1 time: 0.084009 Sep 05 12:39:43.301864 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 549/1081] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:43 2022] GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:44.080626 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1dc4dfd3-24b0-4fef-9f97-76fbd50a5ae3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:44.082699 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1dc4dfd3-24b0-4fef-9f97-76fbd50a5ae3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:44.096550 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1dc4dfd3-24b0-4fef-9f97-76fbd50a5ae3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:44.099335 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1dc4dfd3-24b0-4fef-9f97-76fbd50a5ae3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:44.100232 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1dc4dfd3-24b0-4fef-9f97-76fbd50a5ae3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:44.101184 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1dc4dfd3-24b0-4fef-9f97-76fbd50a5ae3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:44.102927 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1dc4dfd3-24b0-4fef-9f97-76fbd50a5ae3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:44.103429 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1dc4dfd3-24b0-4fef-9f97-76fbd50a5ae3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:44.264885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1dc4dfd3-24b0-4fef-9f97-76fbd50a5ae3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:44.273639 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1dc4dfd3-24b0-4fef-9f97-76fbd50a5ae3 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1678 microversion: 2.1 time: 0.199025 Sep 05 12:39:44.274219 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 533/1082] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:44 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1678 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:44.323938 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-6c9c46aa-0f1c-4431-9c5e-5ffe81191ed0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:44.324560 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-6c9c46aa-0f1c-4431-9c5e-5ffe81191ed0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:44.331293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c9c46aa-0f1c-4431-9c5e-5ffe81191ed0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:44.331831 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c9c46aa-0f1c-4431-9c5e-5ffe81191ed0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:44.332267 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c9c46aa-0f1c-4431-9c5e-5ffe81191ed0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:44.332965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c9c46aa-0f1c-4431-9c5e-5ffe81191ed0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:44.333419 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c9c46aa-0f1c-4431-9c5e-5ffe81191ed0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:44.333841 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c9c46aa-0f1c-4431-9c5e-5ffe81191ed0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:44.401235 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6c9c46aa-0f1c-4431-9c5e-5ffe81191ed0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:44.410479 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-6c9c46aa-0f1c-4431-9c5e-5ffe81191ed0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123" status: 200 len: 1271 microversion: 2.1 time: 0.089920 Sep 05 12:39:44.410807 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 550/1083] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:44 2022] GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:45.297440 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-282f4902-fc04-4724-b424-7b9d9939ee1c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:45.298193 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-282f4902-fc04-4724-b424-7b9d9939ee1c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:45.300759 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:45.305456 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-282f4902-fc04-4724-b424-7b9d9939ee1c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:45.305954 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-282f4902-fc04-4724-b424-7b9d9939ee1c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:45.306389 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-282f4902-fc04-4724-b424-7b9d9939ee1c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:45.312190 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-282f4902-fc04-4724-b424-7b9d9939ee1c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:45.312190 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-282f4902-fc04-4724-b424-7b9d9939ee1c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:45.312190 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-282f4902-fc04-4724-b424-7b9d9939ee1c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:45.435305 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-fb405c31-9033-4261-bd95-9800435c7b10 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:45.436084 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-fb405c31-9033-4261-bd95-9800435c7b10 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:45.444673 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:45.449314 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fb405c31-9033-4261-bd95-9800435c7b10 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:45.449803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fb405c31-9033-4261-bd95-9800435c7b10 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:45.450232 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fb405c31-9033-4261-bd95-9800435c7b10 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:45.453710 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fb405c31-9033-4261-bd95-9800435c7b10 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:45.455181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fb405c31-9033-4261-bd95-9800435c7b10 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:45.455181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fb405c31-9033-4261-bd95-9800435c7b10 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:45.535915 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-fb405c31-9033-4261-bd95-9800435c7b10 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:45.544800 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-fb405c31-9033-4261-bd95-9800435c7b10 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123" status: 200 len: 1277 microversion: 2.1 time: 0.113879 Sep 05 12:39:45.545706 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 551/1084] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:45 2022] GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123 => generated 1277 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:45.557402 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-282f4902-fc04-4724-b424-7b9d9939ee1c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:45.569009 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-282f4902-fc04-4724-b424-7b9d9939ee1c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1678 microversion: 2.1 time: 0.275912 Sep 05 12:39:45.576599 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 534/1085] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:45 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1678 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:46.569874 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-78875940-cbd7-4b49-824c-969708ba47c7 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:46.571263 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-78875940-cbd7-4b49-824c-969708ba47c7 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:46.580001 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-78875940-cbd7-4b49-824c-969708ba47c7 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:46.582599 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-78875940-cbd7-4b49-824c-969708ba47c7 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:46.582599 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-78875940-cbd7-4b49-824c-969708ba47c7 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:46.582599 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-78875940-cbd7-4b49-824c-969708ba47c7 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:46.582599 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-78875940-cbd7-4b49-824c-969708ba47c7 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:46.582982 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-78875940-cbd7-4b49-824c-969708ba47c7 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:46.598290 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d280f909-8769-4e8f-b15f-eac12434a9ae tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:46.599695 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d280f909-8769-4e8f-b15f-eac12434a9ae tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:46.608414 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d280f909-8769-4e8f-b15f-eac12434a9ae tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:46.609324 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d280f909-8769-4e8f-b15f-eac12434a9ae tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:46.609990 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d280f909-8769-4e8f-b15f-eac12434a9ae tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:46.610990 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d280f909-8769-4e8f-b15f-eac12434a9ae tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:46.611769 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d280f909-8769-4e8f-b15f-eac12434a9ae tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:46.612438 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d280f909-8769-4e8f-b15f-eac12434a9ae tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:46.748416 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-78875940-cbd7-4b49-824c-969708ba47c7 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:46.759509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-78875940-cbd7-4b49-824c-969708ba47c7 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123" status: 200 len: 1319 microversion: 2.1 time: 0.191293 Sep 05 12:39:46.759509 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 552/1086] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:46 2022] GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:46.811893 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d280f909-8769-4e8f-b15f-eac12434a9ae tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:46.819488 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d280f909-8769-4e8f-b15f-eac12434a9ae tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1655 microversion: 2.1 time: 0.226075 Sep 05 12:39:46.823621 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 535/1087] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:46 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1655 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:46.843894 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d6f1301e-603f-4598-95d2-3e6a62aa300f tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:39:46.850075 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d6f1301e-603f-4598-95d2-3e6a62aa300f tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:46.850559 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d6f1301e-603f-4598-95d2-3e6a62aa300f tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:46.850997 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d6f1301e-603f-4598-95d2-3e6a62aa300f tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:46.872982 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d6f1301e-603f-4598-95d2-3e6a62aa300f tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Going to try to start instance {{(pid=121211) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 05 12:39:47.043715 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d6f1301e-603f-4598-95d2-3e6a62aa300f tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "POST /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14/action" status: 202 len: 0 microversion: 2.1 time: 0.204473 Sep 05 12:39:47.044356 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 553/1088] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Sep 5 12:39:46 2022] POST /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:39:47.069537 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-05b0c163-6c37-4c51-b369-7f356029ffdc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:47.070154 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-05b0c163-6c37-4c51-b369-7f356029ffdc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:47.077089 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-05b0c163-6c37-4c51-b369-7f356029ffdc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:47.077490 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-05b0c163-6c37-4c51-b369-7f356029ffdc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:47.077919 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-05b0c163-6c37-4c51-b369-7f356029ffdc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:47.078616 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-05b0c163-6c37-4c51-b369-7f356029ffdc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:47.079063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-05b0c163-6c37-4c51-b369-7f356029ffdc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:47.079486 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-05b0c163-6c37-4c51-b369-7f356029ffdc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:47.237656 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-05b0c163-6c37-4c51-b369-7f356029ffdc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:47.245410 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-05b0c163-6c37-4c51-b369-7f356029ffdc tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1664 microversion: 2.1 time: 0.184971 Sep 05 12:39:47.246018 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 536/1089] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:47 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1664 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:47.306235 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-f129d598-3498-4116-a19b-9339ed2e92c7 req-c86ab2f7-59b0-4107-85c5-208f971a8c57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0697a8cd-6c7d-418f-b704-0c989d226123", "tag": "fdfbc8cd-09b6-4716-b9d7-630ed9f04518"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:39:47.319232 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-f129d598-3498-4116-a19b-9339ed2e92c7 req-c86ab2f7-59b0-4107-85c5-208f971a8c57 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:47.319750 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-f129d598-3498-4116-a19b-9339ed2e92c7 req-c86ab2f7-59b0-4107-85c5-208f971a8c57 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:47.320236 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-f129d598-3498-4116-a19b-9339ed2e92c7 req-c86ab2f7-59b0-4107-85c5-208f971a8c57 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:47.336287 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-f129d598-3498-4116-a19b-9339ed2e92c7 req-c86ab2f7-59b0-4107-85c5-208f971a8c57 service nova] Creating event network-changed:fdfbc8cd-09b6-4716-b9d7-630ed9f04518 for instance 0697a8cd-6c7d-418f-b704-0c989d226123 on hv-cinder-80135 Sep 05 12:39:47.341189 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-f129d598-3498-4116-a19b-9339ed2e92c7 req-c86ab2f7-59b0-4107-85c5-208f971a8c57 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040333 Sep 05 12:39:47.342185 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 554/1090] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:39:47.779631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a1f96731-9ad4-4ab6-a18e-8bde0de6c4c0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:47.780253 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a1f96731-9ad4-4ab6-a18e-8bde0de6c4c0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:47.787059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a1f96731-9ad4-4ab6-a18e-8bde0de6c4c0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:47.787580 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a1f96731-9ad4-4ab6-a18e-8bde0de6c4c0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:47.788012 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a1f96731-9ad4-4ab6-a18e-8bde0de6c4c0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:47.788723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a1f96731-9ad4-4ab6-a18e-8bde0de6c4c0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:47.789179 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a1f96731-9ad4-4ab6-a18e-8bde0de6c4c0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:47.789608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a1f96731-9ad4-4ab6-a18e-8bde0de6c4c0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:47.992560 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a1f96731-9ad4-4ab6-a18e-8bde0de6c4c0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:48.005341 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a1f96731-9ad4-4ab6-a18e-8bde0de6c4c0 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123" status: 200 len: 1319 microversion: 2.1 time: 0.229277 Sep 05 12:39:48.006965 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 537/1091] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:47 2022] GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:48.271635 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a008dd6f-d71d-4d52-bde3-6ff31ab99d8a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:48.274247 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a008dd6f-d71d-4d52-bde3-6ff31ab99d8a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:48.279046 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a008dd6f-d71d-4d52-bde3-6ff31ab99d8a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:48.279524 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a008dd6f-d71d-4d52-bde3-6ff31ab99d8a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:48.280468 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a008dd6f-d71d-4d52-bde3-6ff31ab99d8a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:48.281157 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a008dd6f-d71d-4d52-bde3-6ff31ab99d8a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:48.281602 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a008dd6f-d71d-4d52-bde3-6ff31ab99d8a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:48.282022 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a008dd6f-d71d-4d52-bde3-6ff31ab99d8a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:48.414693 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a008dd6f-d71d-4d52-bde3-6ff31ab99d8a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:48.423048 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a008dd6f-d71d-4d52-bde3-6ff31ab99d8a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1664 microversion: 2.1 time: 0.156111 Sep 05 12:39:48.423649 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 555/1092] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:48 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:49.031709 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a8590743-96f6-4a16-89c1-d0feb8cba2dc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:49.032306 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a8590743-96f6-4a16-89c1-d0feb8cba2dc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:49.039012 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a8590743-96f6-4a16-89c1-d0feb8cba2dc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:49.039486 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a8590743-96f6-4a16-89c1-d0feb8cba2dc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:49.040041 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a8590743-96f6-4a16-89c1-d0feb8cba2dc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:49.040726 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a8590743-96f6-4a16-89c1-d0feb8cba2dc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:49.041169 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a8590743-96f6-4a16-89c1-d0feb8cba2dc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:49.041582 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a8590743-96f6-4a16-89c1-d0feb8cba2dc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:49.175257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a8590743-96f6-4a16-89c1-d0feb8cba2dc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:49.183026 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a8590743-96f6-4a16-89c1-d0feb8cba2dc tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123" status: 200 len: 1319 microversion: 2.1 time: 0.155304 Sep 05 12:39:49.183689 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 538/1093] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:49 2022] GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:49.447145 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-cf216e62-7f76-4055-982a-fb5f19e9de95 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:49.447766 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-cf216e62-7f76-4055-982a-fb5f19e9de95 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:49.454472 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cf216e62-7f76-4055-982a-fb5f19e9de95 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:49.454955 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cf216e62-7f76-4055-982a-fb5f19e9de95 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:49.455387 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cf216e62-7f76-4055-982a-fb5f19e9de95 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:49.456128 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cf216e62-7f76-4055-982a-fb5f19e9de95 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:49.456584 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cf216e62-7f76-4055-982a-fb5f19e9de95 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:49.457040 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-cf216e62-7f76-4055-982a-fb5f19e9de95 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:49.591577 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-cf216e62-7f76-4055-982a-fb5f19e9de95 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:49.599949 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-cf216e62-7f76-4055-982a-fb5f19e9de95 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1668 microversion: 2.1 time: 0.156824 Sep 05 12:39:49.600518 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 556/1094] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:49 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:50.206941 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d0d9198b-0e6b-46ff-abc6-b573a18ed554 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:50.207594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d0d9198b-0e6b-46ff-abc6-b573a18ed554 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:50.214560 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d0d9198b-0e6b-46ff-abc6-b573a18ed554 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:50.215076 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d0d9198b-0e6b-46ff-abc6-b573a18ed554 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:50.215507 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d0d9198b-0e6b-46ff-abc6-b573a18ed554 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:50.216243 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d0d9198b-0e6b-46ff-abc6-b573a18ed554 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:50.216691 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d0d9198b-0e6b-46ff-abc6-b573a18ed554 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:50.217109 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d0d9198b-0e6b-46ff-abc6-b573a18ed554 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:50.358311 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d0d9198b-0e6b-46ff-abc6-b573a18ed554 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:50.366788 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d0d9198b-0e6b-46ff-abc6-b573a18ed554 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123" status: 200 len: 1319 microversion: 2.1 time: 0.164428 Sep 05 12:39:50.367361 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 539/1095] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:50 2022] GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:51.391156 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d3ec3505-2476-4e77-b8d4-46e63f5a5153 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:51.391740 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d3ec3505-2476-4e77-b8d4-46e63f5a5153 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:51.398492 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d3ec3505-2476-4e77-b8d4-46e63f5a5153 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:51.398972 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d3ec3505-2476-4e77-b8d4-46e63f5a5153 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:51.399401 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d3ec3505-2476-4e77-b8d4-46e63f5a5153 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:51.400123 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d3ec3505-2476-4e77-b8d4-46e63f5a5153 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:51.400573 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d3ec3505-2476-4e77-b8d4-46e63f5a5153 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:51.400991 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d3ec3505-2476-4e77-b8d4-46e63f5a5153 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:51.537514 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d3ec3505-2476-4e77-b8d4-46e63f5a5153 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:51.545366 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d3ec3505-2476-4e77-b8d4-46e63f5a5153 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123" status: 200 len: 1319 microversion: 2.1 time: 0.158210 Sep 05 12:39:51.546426 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 557/1096] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:51 2022] GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:52.568893 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a0b2c7c9-6c0d-4288-90f3-782cfc83395a tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:52.569545 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a0b2c7c9-6c0d-4288-90f3-782cfc83395a tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:52.572159 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 12:39:52.572300 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Mon Sep 5 12:39:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123 (ip 10.222.0.62) !!! Sep 05 12:39:52.573225 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=2 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:52.573961 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=6 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:52.580759 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a0b2c7c9-6c0d-4288-90f3-782cfc83395a tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:52.582702 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a0b2c7c9-6c0d-4288-90f3-782cfc83395a tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:52.582702 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a0b2c7c9-6c0d-4288-90f3-782cfc83395a tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:52.582702 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a0b2c7c9-6c0d-4288-90f3-782cfc83395a tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:52.583059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a0b2c7c9-6c0d-4288-90f3-782cfc83395a tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:52.583522 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a0b2c7c9-6c0d-4288-90f3-782cfc83395a tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:52.717648 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a0b2c7c9-6c0d-4288-90f3-782cfc83395a tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:52.725539 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a0b2c7c9-6c0d-4288-90f3-782cfc83395a tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123" status: 200 len: 1319 microversion: 2.1 time: 0.160702 Sep 05 12:39:52.726111 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 540/1097] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:52 2022] GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:53.152972 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-31064c19-4384-49e7-acb2-58a82a2a9e85 req-a1af40e1-76a9-43a7-83d2-5b8195094286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0697a8cd-6c7d-418f-b704-0c989d226123", "name": "network-vif-plugged", "status": "completed", "tag": "fdfbc8cd-09b6-4716-b9d7-630ed9f04518"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:39:53.158516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=2 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:53.164259 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-31064c19-4384-49e7-acb2-58a82a2a9e85 req-a1af40e1-76a9-43a7-83d2-5b8195094286 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:53.164746 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-31064c19-4384-49e7-acb2-58a82a2a9e85 req-a1af40e1-76a9-43a7-83d2-5b8195094286 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:53.165181 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-31064c19-4384-49e7-acb2-58a82a2a9e85 req-a1af40e1-76a9-43a7-83d2-5b8195094286 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:53.177238 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-31064c19-4384-49e7-acb2-58a82a2a9e85 req-a1af40e1-76a9-43a7-83d2-5b8195094286 service nova] Creating event network-vif-plugged:fdfbc8cd-09b6-4716-b9d7-630ed9f04518 for instance 0697a8cd-6c7d-418f-b704-0c989d226123 on hv-cinder-80135 Sep 05 12:39:53.182324 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-31064c19-4384-49e7-acb2-58a82a2a9e85 req-a1af40e1-76a9-43a7-83d2-5b8195094286 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033057 Sep 05 12:39:53.183080 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 558/1098] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:39:53.748395 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-86ed51e7-826b-4de7-9328-44b20da48349 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:53.749045 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-86ed51e7-826b-4de7-9328-44b20da48349 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:53.755701 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-86ed51e7-826b-4de7-9328-44b20da48349 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:53.756184 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-86ed51e7-826b-4de7-9328-44b20da48349 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:53.756615 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-86ed51e7-826b-4de7-9328-44b20da48349 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:53.757296 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-86ed51e7-826b-4de7-9328-44b20da48349 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:53.757749 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-86ed51e7-826b-4de7-9328-44b20da48349 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:53.758172 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-86ed51e7-826b-4de7-9328-44b20da48349 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:53.886271 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-86ed51e7-826b-4de7-9328-44b20da48349 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:53.890687 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=100 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:53.895107 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-86ed51e7-826b-4de7-9328-44b20da48349 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123" status: 200 len: 1319 microversion: 2.1 time: 0.150626 Sep 05 12:39:53.895695 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 541/1099] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:53 2022] GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:54.920059 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-aff02da9-4cce-4a80-b01c-31967b885a07 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:39:54.920755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-aff02da9-4cce-4a80-b01c-31967b885a07 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:54.927028 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aff02da9-4cce-4a80-b01c-31967b885a07 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:54.927511 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aff02da9-4cce-4a80-b01c-31967b885a07 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:54.927969 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aff02da9-4cce-4a80-b01c-31967b885a07 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:54.928658 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aff02da9-4cce-4a80-b01c-31967b885a07 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:54.929108 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aff02da9-4cce-4a80-b01c-31967b885a07 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:54.929528 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aff02da9-4cce-4a80-b01c-31967b885a07 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:55.066387 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-aff02da9-4cce-4a80-b01c-31967b885a07 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:39:55.074385 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-aff02da9-4cce-4a80-b01c-31967b885a07 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123" status: 200 len: 1508 microversion: 2.1 time: 0.159599 Sep 05 12:39:55.074959 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 559/1100] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:39:54 2022] GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:39:55.096488 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-194997eb-3e66-47ba-9269-9af96a5c3e26 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81d50a08-45b2-4c29-963f-1463086fa734", "device": "/dev/sdb"}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:39:55.099459 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-194997eb-3e66-47ba-9269-9af96a5c3e26 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:39:55.106371 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-194997eb-3e66-47ba-9269-9af96a5c3e26 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:55.106858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-194997eb-3e66-47ba-9269-9af96a5c3e26 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:55.107293 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-194997eb-3e66-47ba-9269-9af96a5c3e26 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:55.108017 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-194997eb-3e66-47ba-9269-9af96a5c3e26 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:39:55.108989 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-194997eb-3e66-47ba-9269-9af96a5c3e26 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:39:55.109448 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-194997eb-3e66-47ba-9269-9af96a5c3e26 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:39:56.019140 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-194997eb-3e66-47ba-9269-9af96a5c3e26 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "POST /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.926393 Sep 05 12:39:56.019855 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 542/1101] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Sep 5 12:39:55 2022] POST /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123/os-volume_attachments => generated 194 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:40:16.069352 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4c0f25ee-1889-47a3-93f2-f6551b0cb4d5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:16.069895 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-4c0f25ee-1889-47a3-93f2-f6551b0cb4d5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:16.071963 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=17 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:16.072790 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:16.136801 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4c0f25ee-1889-47a3-93f2-f6551b0cb4d5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:16.136801 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4c0f25ee-1889-47a3-93f2-f6551b0cb4d5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:16.136801 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4c0f25ee-1889-47a3-93f2-f6551b0cb4d5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:16.136801 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4c0f25ee-1889-47a3-93f2-f6551b0cb4d5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:16.137470 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4c0f25ee-1889-47a3-93f2-f6551b0cb4d5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:16.137470 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-4c0f25ee-1889-47a3-93f2-f6551b0cb4d5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:16.160947 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.objects.instance [None req-4c0f25ee-1889-47a3-93f2-f6551b0cb4d5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lazy-loading 'services' on Instance uuid 0697a8cd-6c7d-418f-b704-0c989d226123 {{(pid=121211) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:40:16.448963 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4c0f25ee-1889-47a3-93f2-f6551b0cb4d5 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123/os-volume_attachments/81d50a08-45b2-4c29-963f-1463086fa734" status: 202 len: 0 microversion: 2.1 time: 0.383949 Sep 05 12:40:16.449447 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 560/1102] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Sep 5 12:40:16 2022] DELETE /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123/os-volume_attachments/81d50a08-45b2-4c29-963f-1463086fa734 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:40:18.624934 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=17 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:18.625804 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:18.630330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-913a7c86-6181-4fa6-bbc8-ca9d7e4e60e1 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:18.630947 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-913a7c86-6181-4fa6-bbc8-ca9d7e4e60e1 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:18.637134 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-913a7c86-6181-4fa6-bbc8-ca9d7e4e60e1 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:18.638604 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-913a7c86-6181-4fa6-bbc8-ca9d7e4e60e1 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:18.638604 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-913a7c86-6181-4fa6-bbc8-ca9d7e4e60e1 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:18.638916 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-913a7c86-6181-4fa6-bbc8-ca9d7e4e60e1 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:18.639182 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-913a7c86-6181-4fa6-bbc8-ca9d7e4e60e1 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:18.639633 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-913a7c86-6181-4fa6-bbc8-ca9d7e4e60e1 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:18.665237 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-913a7c86-6181-4fa6-bbc8-ca9d7e4e60e1 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] Going to try to terminate instance {{(pid=121210) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:40:18.977884 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-913a7c86-6181-4fa6-bbc8-ca9d7e4e60e1 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123" status: 204 len: 0 microversion: 2.1 time: 0.354288 Sep 05 12:40:18.978513 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 543/1103] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:40:18 2022] DELETE /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:40:18.988171 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7d422d3e-ed95-4f4f-b15c-8a4234590c62 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:18.988862 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-7d422d3e-ed95-4f4f-b15c-8a4234590c62 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:18.995089 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7d422d3e-ed95-4f4f-b15c-8a4234590c62 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:18.995599 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7d422d3e-ed95-4f4f-b15c-8a4234590c62 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:18.996040 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7d422d3e-ed95-4f4f-b15c-8a4234590c62 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:18.996736 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7d422d3e-ed95-4f4f-b15c-8a4234590c62 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:18.997213 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7d422d3e-ed95-4f4f-b15c-8a4234590c62 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:18.997639 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7d422d3e-ed95-4f4f-b15c-8a4234590c62 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:19.131977 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-7d422d3e-ed95-4f4f-b15c-8a4234590c62 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:19.139830 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-7d422d3e-ed95-4f4f-b15c-8a4234590c62 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123" status: 200 len: 1514 microversion: 2.1 time: 0.156632 Sep 05 12:40:19.140399 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 561/1104] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:18 2022] GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:40:20.163644 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1aa3e5d0-4944-4384-94d6-3f80c2de344c tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:20.164294 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1aa3e5d0-4944-4384-94d6-3f80c2de344c tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:20.170822 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1aa3e5d0-4944-4384-94d6-3f80c2de344c tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:20.171300 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1aa3e5d0-4944-4384-94d6-3f80c2de344c tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:20.171748 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1aa3e5d0-4944-4384-94d6-3f80c2de344c tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:20.172493 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1aa3e5d0-4944-4384-94d6-3f80c2de344c tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:20.172937 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1aa3e5d0-4944-4384-94d6-3f80c2de344c tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:20.173353 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1aa3e5d0-4944-4384-94d6-3f80c2de344c tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:20.308365 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1aa3e5d0-4944-4384-94d6-3f80c2de344c tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:20.316682 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1aa3e5d0-4944-4384-94d6-3f80c2de344c tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123" status: 200 len: 1514 microversion: 2.1 time: 0.157437 Sep 05 12:40:20.317249 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 544/1105] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:20 2022] GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:21.341144 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-99958dee-f973-4bd2-84a2-deae4665fc66 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:21.341760 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-99958dee-f973-4bd2-84a2-deae4665fc66 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:21.348790 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-99958dee-f973-4bd2-84a2-deae4665fc66 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:21.349267 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-99958dee-f973-4bd2-84a2-deae4665fc66 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:21.349703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-99958dee-f973-4bd2-84a2-deae4665fc66 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:21.350391 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-99958dee-f973-4bd2-84a2-deae4665fc66 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:21.350852 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-99958dee-f973-4bd2-84a2-deae4665fc66 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:21.351277 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-99958dee-f973-4bd2-84a2-deae4665fc66 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:21.434274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-99958dee-f973-4bd2-84a2-deae4665fc66 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:21.446024 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-99958dee-f973-4bd2-84a2-deae4665fc66 tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123" status: 200 len: 1472 microversion: 2.1 time: 0.108127 Sep 05 12:40:21.453485 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 562/1106] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:21 2022] GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123 => generated 1472 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:21.717745 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-509dcd09-f6bb-4c11-82cf-9216108b4979 req-6ba750e9-dcbf-45f1-9cef-7ab5d356c72d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0697a8cd-6c7d-418f-b704-0c989d226123", "name": "network-vif-deleted", "tag": "fdfbc8cd-09b6-4716-b9d7-630ed9f04518"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:40:21.727814 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-509dcd09-f6bb-4c11-82cf-9216108b4979 req-6ba750e9-dcbf-45f1-9cef-7ab5d356c72d service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:21.728533 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-509dcd09-f6bb-4c11-82cf-9216108b4979 req-6ba750e9-dcbf-45f1-9cef-7ab5d356c72d service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:21.729019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-509dcd09-f6bb-4c11-82cf-9216108b4979 req-6ba750e9-dcbf-45f1-9cef-7ab5d356c72d service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:21.740275 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-509dcd09-f6bb-4c11-82cf-9216108b4979 req-6ba750e9-dcbf-45f1-9cef-7ab5d356c72d service nova] Creating event network-vif-deleted:fdfbc8cd-09b6-4716-b9d7-630ed9f04518 for instance 0697a8cd-6c7d-418f-b704-0c989d226123 on hv-cinder-80135 Sep 05 12:40:21.747754 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-509dcd09-f6bb-4c11-82cf-9216108b4979 req-6ba750e9-dcbf-45f1-9cef-7ab5d356c72d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220501 Sep 05 12:40:21.747754 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 545/1107] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:40:22.471766 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0ea1e36e-abe6-4c2b-ba97-3c341f308dfa tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:22.472416 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0ea1e36e-abe6-4c2b-ba97-3c341f308dfa tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:22.478861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0ea1e36e-abe6-4c2b-ba97-3c341f308dfa tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:22.479344 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0ea1e36e-abe6-4c2b-ba97-3c341f308dfa tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:22.479816 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0ea1e36e-abe6-4c2b-ba97-3c341f308dfa tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:22.480514 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0ea1e36e-abe6-4c2b-ba97-3c341f308dfa tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:22.480973 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0ea1e36e-abe6-4c2b-ba97-3c341f308dfa tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:22.481402 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0ea1e36e-abe6-4c2b-ba97-3c341f308dfa tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:22.512634 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0ea1e36e-abe6-4c2b-ba97-3c341f308dfa tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:22.513124 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0ea1e36e-abe6-4c2b-ba97-3c341f308dfa tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:22.513646 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0ea1e36e-abe6-4c2b-ba97-3c341f308dfa tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:22.514044 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.objects.instance [None req-0ea1e36e-abe6-4c2b-ba97-3c341f308dfa tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lazy-loading 'fault' on Instance uuid 0697a8cd-6c7d-418f-b704-0c989d226123 {{(pid=121211) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:40:22.555497 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0ea1e36e-abe6-4c2b-ba97-3c341f308dfa tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c22d28f87c941afb1fad1cfaf3a5fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a77deb0bf54420e90c26e66699b3611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:22.563211 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0ea1e36e-abe6-4c2b-ba97-3c341f308dfa tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123" status: 200 len: 1309 microversion: 2.1 time: 0.095891 Sep 05 12:40:22.563921 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 563/1108] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:22 2022] GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:23.586442 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1b1498a1-7c79-4b03-9af0-e11f7c29172e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:23.587126 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1b1498a1-7c79-4b03-9af0-e11f7c29172e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] [instance: 0697a8cd-6c7d-418f-b704-0c989d226123] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:23.593432 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1b1498a1-7c79-4b03-9af0-e11f7c29172e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:23.593935 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1b1498a1-7c79-4b03-9af0-e11f7c29172e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:23.594367 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1b1498a1-7c79-4b03-9af0-e11f7c29172e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:23.595055 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1b1498a1-7c79-4b03-9af0-e11f7c29172e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:23.595530 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1b1498a1-7c79-4b03-9af0-e11f7c29172e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:23.595955 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1b1498a1-7c79-4b03-9af0-e11f7c29172e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:23.608986 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-1b1498a1-7c79-4b03-9af0-e11f7c29172e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] HTTP exception thrown: Instance 0697a8cd-6c7d-418f-b704-0c989d226123 could not be found. Sep 05 12:40:23.610594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1b1498a1-7c79-4b03-9af0-e11f7c29172e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Request method failure captured: Sep 05 12:40:23.610594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123 HTTP/1.1 Sep 05 12:40:23.610594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:40:23.610594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:40:23.610594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:40:23.610594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:40:23.610594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:40:23.610594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:40:23.610594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:40:23.610594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:40:23.610594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFe29pEuL4a2dmBrOtHUEaF2yg1QiMQGJL8fTSMgigeKMpg2U8Cxa8f-rcd3OvIZM5WOWm1k-1dgkIILVTHilDMrB9ZGP665ZGx1v4UHxShuqlKdYVog8hmiCTWS6nSDu7vxKxAyJvAsbQIMx-dXswHmWg4m2kuY39WIkFew54AtrfU0 Sep 05 12:40:23.610594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:40:23.610594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:40:23.610594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:40:23.610594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:40:23.610594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:40:23.610594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:40:23.610594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 2a77deb0bf54420e90c26e66699b3611 Sep 05 12:40:23.610594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1467014265 Sep 05 12:40:23.610594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:40:23.610594 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:40:23.612916 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2a77deb0bf54420e90c26e66699b3611"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2a77deb0bf54420e90c26e66699b3611"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2a77deb0bf54420e90c26e66699b3611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2a77deb0bf54420e90c26e66699b3611"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:40:23.612916 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-VolumesSnapshotTestJSON-1467014265 Sep 05 12:40:23.612916 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 2a77deb0bf54420e90c26e66699b3611 Sep 05 12:40:23.612916 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1467014265 Sep 05 12:40:23.612916 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-VolumesSnapshotTestJSON-1467014265-project Sep 05 12:40:23.612916 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:40:23.612916 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:40:23.612916 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: 6c22d28f87c941afb1fad1cfaf3a5fb2 Sep 05 12:40:23.612916 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-VolumesSnapshotTestJSON-1467014265-project Sep 05 12:40:23.612916 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:40:23.612916 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance 0697a8cd-6c7d-418f-b704-0c989d226123 could not be found. Sep 05 12:40:23.612916 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': '0697a8cd-6c7d-418f-b704-0c989d226123'} Sep 05 12:40:23.613885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:40:23.613885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:40:23.613885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:40:23.613885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:40:23.613885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:40:23.613885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:40:23.613885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:40:23.613885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:40:23.613885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:40:23.613885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:40:23.613885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0697a8cd-6c7d-418f-b704-0c989d226123 could not be found. Sep 05 12:40:23.613885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:40:23.613885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:40:23.613885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:40:23.613885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:40:23.613885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:40:23.613885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:40:23.613885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:40:23.613885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:40:23.613885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:40:23.615499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:40:23.615499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:40:23.615499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:40:23.615499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:40:23.615499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:40:23.615499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:40:23.615499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:40:23.615499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0697a8cd-6c7d-418f-b704-0c989d226123 could not be found. Sep 05 12:40:23.615499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:40:23.615499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:40:23.615499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:40:23.615499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:40:23.615499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:40:23.615499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:40:23.615499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:40:23.615499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:40:23.615499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0697a8cd-6c7d-418f-b704-0c989d226123 could not be found. Sep 05 12:40:23.615499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:40:23.617159 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1b1498a1-7c79-4b03-9af0-e11f7c29172e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] Returning 404 to user: Instance 0697a8cd-6c7d-418f-b704-0c989d226123 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:40:23.617159 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1b1498a1-7c79-4b03-9af0-e11f7c29172e tempest-VolumesSnapshotTestJSON-1467014265 tempest-VolumesSnapshotTestJSON-1467014265-project] 10.222.0.62 "GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123" status: 404 len: 111 microversion: 2.1 time: 0.030744 Sep 05 12:40:23.617159 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 546/1109] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:23 2022] GET /compute/v2.1/servers/0697a8cd-6c7d-418f-b704-0c989d226123 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:40:25.417459 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-bbf123fc-85c9-4f8f-997a-22594fd48382 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:25.419762 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-bbf123fc-85c9-4f8f-997a-22594fd48382 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:25.426882 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bbf123fc-85c9-4f8f-997a-22594fd48382 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:25.427362 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bbf123fc-85c9-4f8f-997a-22594fd48382 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:25.427824 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bbf123fc-85c9-4f8f-997a-22594fd48382 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:25.428510 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bbf123fc-85c9-4f8f-997a-22594fd48382 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:25.428952 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bbf123fc-85c9-4f8f-997a-22594fd48382 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:25.429368 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-bbf123fc-85c9-4f8f-997a-22594fd48382 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:25.458879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-bbf123fc-85c9-4f8f-997a-22594fd48382 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045360 Sep 05 12:40:25.459561 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 564/1110] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:40:25 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 12:40:25.527796 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-185b9a9c-93e9-4370-87e5-7067dc2cd724 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:25.528299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-185b9a9c-93e9-4370-87e5-7067dc2cd724 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:25.535114 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-185b9a9c-93e9-4370-87e5-7067dc2cd724 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:25.538483 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-185b9a9c-93e9-4370-87e5-7067dc2cd724 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:25.538483 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-185b9a9c-93e9-4370-87e5-7067dc2cd724 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:25.538483 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-185b9a9c-93e9-4370-87e5-7067dc2cd724 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:25.538483 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-185b9a9c-93e9-4370-87e5-7067dc2cd724 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:25.539007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-185b9a9c-93e9-4370-87e5-7067dc2cd724 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:25.563302 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-185b9a9c-93e9-4370-87e5-7067dc2cd724 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Going to try to terminate instance {{(pid=121210) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:40:25.922659 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-185b9a9c-93e9-4370-87e5-7067dc2cd724 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 204 len: 0 microversion: 2.1 time: 0.398341 Sep 05 12:40:25.923187 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 547/1111] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:40:25 2022] DELETE /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:40:25.931196 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-eea0c679-14eb-4fa9-bf6f-da5d34cf03ce tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:25.931919 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-eea0c679-14eb-4fa9-bf6f-da5d34cf03ce tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:25.938065 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-eea0c679-14eb-4fa9-bf6f-da5d34cf03ce tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:25.938563 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-eea0c679-14eb-4fa9-bf6f-da5d34cf03ce tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:25.938992 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-eea0c679-14eb-4fa9-bf6f-da5d34cf03ce tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:25.939701 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-eea0c679-14eb-4fa9-bf6f-da5d34cf03ce tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:25.940180 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-eea0c679-14eb-4fa9-bf6f-da5d34cf03ce tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:25.940597 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-eea0c679-14eb-4fa9-bf6f-da5d34cf03ce tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:26.084968 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-eea0c679-14eb-4fa9-bf6f-da5d34cf03ce tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:26.093195 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-eea0c679-14eb-4fa9-bf6f-da5d34cf03ce tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1674 microversion: 2.1 time: 0.165838 Sep 05 12:40:26.093750 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 565/1112] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:25 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:27.118684 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-11f7124f-751c-44a3-82d6-19a1411b2353 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:27.119377 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-11f7124f-751c-44a3-82d6-19a1411b2353 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:27.125761 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-11f7124f-751c-44a3-82d6-19a1411b2353 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:27.126271 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-11f7124f-751c-44a3-82d6-19a1411b2353 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:27.126753 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-11f7124f-751c-44a3-82d6-19a1411b2353 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:27.127447 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-11f7124f-751c-44a3-82d6-19a1411b2353 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:27.127925 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-11f7124f-751c-44a3-82d6-19a1411b2353 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:27.128346 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-11f7124f-751c-44a3-82d6-19a1411b2353 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:27.256007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-11f7124f-751c-44a3-82d6-19a1411b2353 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:27.263693 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-11f7124f-751c-44a3-82d6-19a1411b2353 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1674 microversion: 2.1 time: 0.149166 Sep 05 12:40:27.264260 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 548/1113] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:27 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:28.287755 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e27710dd-7286-42a9-a1e3-eb6ebb400bd1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:28.288376 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e27710dd-7286-42a9-a1e3-eb6ebb400bd1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:28.294796 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e27710dd-7286-42a9-a1e3-eb6ebb400bd1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:28.295283 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e27710dd-7286-42a9-a1e3-eb6ebb400bd1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:28.295753 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e27710dd-7286-42a9-a1e3-eb6ebb400bd1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:28.296449 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e27710dd-7286-42a9-a1e3-eb6ebb400bd1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:28.296934 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e27710dd-7286-42a9-a1e3-eb6ebb400bd1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:28.297393 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e27710dd-7286-42a9-a1e3-eb6ebb400bd1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:28.431302 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e27710dd-7286-42a9-a1e3-eb6ebb400bd1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:28.438989 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e27710dd-7286-42a9-a1e3-eb6ebb400bd1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1674 microversion: 2.1 time: 0.155183 Sep 05 12:40:28.439599 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 566/1114] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:28 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:29.462813 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a041ba54-9e5b-4ff3-b2fd-eba6cf410f98 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:29.463344 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a041ba54-9e5b-4ff3-b2fd-eba6cf410f98 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:29.469976 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a041ba54-9e5b-4ff3-b2fd-eba6cf410f98 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:29.470486 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a041ba54-9e5b-4ff3-b2fd-eba6cf410f98 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:29.470916 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a041ba54-9e5b-4ff3-b2fd-eba6cf410f98 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:29.471629 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a041ba54-9e5b-4ff3-b2fd-eba6cf410f98 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:29.472083 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a041ba54-9e5b-4ff3-b2fd-eba6cf410f98 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:29.472596 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a041ba54-9e5b-4ff3-b2fd-eba6cf410f98 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:29.614554 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a041ba54-9e5b-4ff3-b2fd-eba6cf410f98 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:29.622335 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a041ba54-9e5b-4ff3-b2fd-eba6cf410f98 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1674 microversion: 2.1 time: 0.163579 Sep 05 12:40:29.622900 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 549/1115] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:29 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:30.647160 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-fe439202-4fc4-4e56-a713-ec0e0871bca0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:30.647812 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-fe439202-4fc4-4e56-a713-ec0e0871bca0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:30.654402 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fe439202-4fc4-4e56-a713-ec0e0871bca0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:30.654889 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fe439202-4fc4-4e56-a713-ec0e0871bca0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:30.655328 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fe439202-4fc4-4e56-a713-ec0e0871bca0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:30.656068 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fe439202-4fc4-4e56-a713-ec0e0871bca0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:30.656531 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fe439202-4fc4-4e56-a713-ec0e0871bca0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:30.656994 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fe439202-4fc4-4e56-a713-ec0e0871bca0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:30.791126 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-fe439202-4fc4-4e56-a713-ec0e0871bca0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:30.800870 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-fe439202-4fc4-4e56-a713-ec0e0871bca0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1674 microversion: 2.1 time: 0.157606 Sep 05 12:40:30.801455 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 567/1116] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:30 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:31.828117 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-44bba638-2025-4c4a-b133-b58384299252 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:31.828734 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-44bba638-2025-4c4a-b133-b58384299252 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:31.835819 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-44bba638-2025-4c4a-b133-b58384299252 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:31.836894 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-44bba638-2025-4c4a-b133-b58384299252 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:31.836894 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-44bba638-2025-4c4a-b133-b58384299252 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:31.837438 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-44bba638-2025-4c4a-b133-b58384299252 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:31.837894 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-44bba638-2025-4c4a-b133-b58384299252 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:31.838315 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-44bba638-2025-4c4a-b133-b58384299252 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:31.901984 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-44bba638-2025-4c4a-b133-b58384299252 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:31.910564 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-44bba638-2025-4c4a-b133-b58384299252 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1606 microversion: 2.1 time: 0.086235 Sep 05 12:40:31.911145 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 550/1117] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:31 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1606 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:32.029446 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-be0b7d65-16ba-4f50-97f6-bf2094b2e52a req-231e7d4b-4d97-4f12-b4d5-3ff1b96a5d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a5d85b-7178-468f-8bc1-f4a6ccef9d14", "name": "network-vif-deleted", "tag": "718e1a6d-4d8c-4ebf-849a-b9dc2ea2c4d1"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:40:32.041529 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-be0b7d65-16ba-4f50-97f6-bf2094b2e52a req-231e7d4b-4d97-4f12-b4d5-3ff1b96a5d42 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:32.042014 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-be0b7d65-16ba-4f50-97f6-bf2094b2e52a req-231e7d4b-4d97-4f12-b4d5-3ff1b96a5d42 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:32.042451 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-be0b7d65-16ba-4f50-97f6-bf2094b2e52a req-231e7d4b-4d97-4f12-b4d5-3ff1b96a5d42 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:32.057516 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-be0b7d65-16ba-4f50-97f6-bf2094b2e52a req-231e7d4b-4d97-4f12-b4d5-3ff1b96a5d42 service nova] Creating event network-vif-deleted:718e1a6d-4d8c-4ebf-849a-b9dc2ea2c4d1 for instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 on hv-cinder-80135 Sep 05 12:40:32.063959 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-be0b7d65-16ba-4f50-97f6-bf2094b2e52a req-231e7d4b-4d97-4f12-b4d5-3ff1b96a5d42 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038707 Sep 05 12:40:32.065535 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 568/1118] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:40:32.934156 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-9844a624-c544-46d0-8703-6a242fc8336d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:32.935157 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-9844a624-c544-46d0-8703-6a242fc8336d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:32.942678 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9844a624-c544-46d0-8703-6a242fc8336d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:32.943254 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9844a624-c544-46d0-8703-6a242fc8336d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:32.943714 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9844a624-c544-46d0-8703-6a242fc8336d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:32.944414 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9844a624-c544-46d0-8703-6a242fc8336d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:32.944871 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9844a624-c544-46d0-8703-6a242fc8336d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:32.945291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9844a624-c544-46d0-8703-6a242fc8336d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:32.979718 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9844a624-c544-46d0-8703-6a242fc8336d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:32.980393 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9844a624-c544-46d0-8703-6a242fc8336d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:32.980975 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-9844a624-c544-46d0-8703-6a242fc8336d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:32.988774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-9844a624-c544-46d0-8703-6a242fc8336d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lazy-loading 'fault' on Instance uuid d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:40:33.034427 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-9844a624-c544-46d0-8703-6a242fc8336d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:33.042099 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-9844a624-c544-46d0-8703-6a242fc8336d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 200 len: 1328 microversion: 2.1 time: 0.111921 Sep 05 12:40:33.042661 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 551/1119] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:32 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 1328 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:34.066912 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-63a31ab7-8e83-405d-99a8-c83b1d3f7d33 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:34.067651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-63a31ab7-8e83-405d-99a8-c83b1d3f7d33 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:34.074559 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-63a31ab7-8e83-405d-99a8-c83b1d3f7d33 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:34.075040 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-63a31ab7-8e83-405d-99a8-c83b1d3f7d33 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:34.075471 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-63a31ab7-8e83-405d-99a8-c83b1d3f7d33 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:34.076202 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-63a31ab7-8e83-405d-99a8-c83b1d3f7d33 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:34.076657 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-63a31ab7-8e83-405d-99a8-c83b1d3f7d33 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:34.077085 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-63a31ab7-8e83-405d-99a8-c83b1d3f7d33 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:34.092943 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-63a31ab7-8e83-405d-99a8-c83b1d3f7d33 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] HTTP exception thrown: Instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 could not be found. Sep 05 12:40:34.094621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-63a31ab7-8e83-405d-99a8-c83b1d3f7d33 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Request method failure captured: Sep 05 12:40:34.094621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 HTTP/1.1 Sep 05 12:40:34.094621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:40:34.094621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:40:34.094621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:40:34.094621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:40:34.094621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:40:34.094621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:40:34.094621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:40:34.094621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:40:34.094621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFe1tu5Jocwz5yIpNgejJjZbGztBoqr5CiMAmR1A_BRIA-NNF_OfAiZoEP0zdiJlL46PHC0fPTzMJPF_OwKatz5VqEPBZgDDI-hRwtpcIgkjzlDx-XFcSPYV8JqkZs7BWflL0iqFPkYmieyeC3GekDBj9lR-DKKB2PHJlUvw7-7B-cHc Sep 05 12:40:34.094621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:40:34.094621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:40:34.094621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:40:34.094621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:40:34.094621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:40:34.094621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:40:34.094621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 7b514c04a13742b1b19d46fec1c40f69 Sep 05 12:40:34.094621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-AttachVolumeTestJSON-972329296 Sep 05 12:40:34.094621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:40:34.094621 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:40:34.097795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:40:34.097795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-AttachVolumeTestJSON-972329296 Sep 05 12:40:34.097795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 7b514c04a13742b1b19d46fec1c40f69 Sep 05 12:40:34.097795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-AttachVolumeTestJSON-972329296 Sep 05 12:40:34.097795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-AttachVolumeTestJSON-972329296-project Sep 05 12:40:34.097795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:40:34.097795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:40:34.097795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: 8bfb013575d540c59121ac8a1613fc0f Sep 05 12:40:34.097795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-AttachVolumeTestJSON-972329296-project Sep 05 12:40:34.097795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: > Sep 05 12:40:34.097795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 could not be found. Sep 05 12:40:34.097795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': 'd7a5d85b-7178-468f-8bc1-f4a6ccef9d14'} Sep 05 12:40:34.099590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:40:34.099590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:40:34.099590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:40:34.099590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:40:34.099590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:40:34.099590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:40:34.099590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:40:34.099590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:40:34.099590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:40:34.099590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:40:34.099590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 could not be found. Sep 05 12:40:34.099590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:40:34.099590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:40:34.099590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:40:34.099590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:40:34.099590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:40:34.099590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:40:34.099590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:40:34.099590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:40:34.099590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:40:34.112927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:40:34.112927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:40:34.112927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:40:34.112927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:40:34.112927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:40:34.112927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:40:34.112927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:40:34.112927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 could not be found. Sep 05 12:40:34.112927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:40:34.112927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:40:34.112927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:40:34.112927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:40:34.112927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:40:34.112927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:40:34.112927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:40:34.112927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:40:34.112927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 could not be found. Sep 05 12:40:34.112927 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:40:34.115061 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-63a31ab7-8e83-405d-99a8-c83b1d3f7d33 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Returning 404 to user: Instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:40:34.115061 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-63a31ab7-8e83-405d-99a8-c83b1d3f7d33 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 404 len: 111 microversion: 2.1 time: 0.034403 Sep 05 12:40:34.115061 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 569/1120] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:34 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:40:34.117950 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e2bada7a-353f-4443-b573-7ffc44dca0d6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '.version_select at 0x7fe7126d3ca0>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:34.224442 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-e2bada7a-353f-4443-b573-7ffc44dca0d6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1075825196" status: 202 len: 0 microversion: 2.1 time: 0.110598 Sep 05 12:40:34.225034 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 552/1121] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Sep 5 12:40:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1075825196 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 05 12:40:35.069118 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a4a3f2d8-12a4-4a4a-9203-c1ef84422389 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Action: 'create', calling method: .version_select at 0x7fe71275dd30>, body: {"keypair": {"name": "tempest-keypair-1122436465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmZptTQfohrvvtPACIiNah5ZK1nDDCGK9QNnB5ZnNJ2ihO+8y2dsu3U+Ikd7/EBWAz1DGMhWzB55s8o7kiSxj75u6v2UFdnaBQBOD0JwvxB1MGyTMQcGamzBL1/Ivz2MQ=="}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:40:35.088486 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-a4a3f2d8-12a4-4a4a-9203-c1ef84422389 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Getting quotas for project 7b514c04a13742b1b19d46fec1c40f69. Resources: {'key_pairs'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:40:35.092565 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-a4a3f2d8-12a4-4a4a-9203-c1ef84422389 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Getting quotas for user 8bfb013575d540c59121ac8a1613fc0f and project 7b514c04a13742b1b19d46fec1c40f69. Resources: {'key_pairs'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:40:35.237285 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a4a3f2d8-12a4-4a4a-9203-c1ef84422389 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.175969 Sep 05 12:40:35.237952 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 570/1122] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Sep 5 12:40:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:40:37.962622 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-2cd65371-1a51-4917-aae5-409484150512 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-587500947", "imageRef": "7844cf5b-4975-4cb9-a7f8-31cc5e52098a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe3deca4-eb5b-4550-84a3-afb4afe5c540"}], "security_groups": [{"name": "tempest-securitygroup--1809704455"}], "key_name": "tempest-keypair-1122436465", "user_data": "}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:40:38.072072 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.network.neutron [None req-2cd65371-1a51-4917-aae5-409484150512 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] validate_networks() for [('fe3deca4-eb5b-4550-84a3-afb4afe5c540', None, None, None, None, None)] {{(pid=121210) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:40:38.706416 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-2cd65371-1a51-4917-aae5-409484150512 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Flavor limits 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:40:38.706834 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-2cd65371-1a51-4917-aae5-409484150512 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Image limits 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:40:38.707300 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-2cd65371-1a51-4917-aae5-409484150512 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Flavor pref 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:40:38.707747 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-2cd65371-1a51-4917-aae5-409484150512 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Image pref 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:40:38.708150 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-2cd65371-1a51-4917-aae5-409484150512 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:40:38.720983 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2cd65371-1a51-4917-aae5-409484150512 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:38.721491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2cd65371-1a51-4917-aae5-409484150512 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:38.721924 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2cd65371-1a51-4917-aae5-409484150512 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:38.722689 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2cd65371-1a51-4917-aae5-409484150512 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:38.723175 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2cd65371-1a51-4917-aae5-409484150512 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:38.723774 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2cd65371-1a51-4917-aae5-409484150512 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:38.741229 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-2cd65371-1a51-4917-aae5-409484150512 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Getting quotas for project 7b514c04a13742b1b19d46fec1c40f69. Resources: {'ram', 'instances', 'cores'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:40:38.745732 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-2cd65371-1a51-4917-aae5-409484150512 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Getting quotas for user 8bfb013575d540c59121ac8a1613fc0f and project 7b514c04a13742b1b19d46fec1c40f69. Resources: {'ram', 'instances', 'cores'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:40:38.757901 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-2cd65371-1a51-4917-aae5-409484150512 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Going to run 1 instances... {{(pid=121210) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:40:38.760266 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-2cd65371-1a51-4917-aae5-409484150512 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7844cf5b-4975-4cb9-a7f8-31cc5e52098a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:40:38.894809 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-2cd65371-1a51-4917-aae5-409484150512 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.936858 Sep 05 12:40:38.895566 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 553/1123] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Sep 5 12:40:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:40:38.907078 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-6b79e171-f4f5-43ba-8b0f-dcc96338f4e6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:38.907756 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-6b79e171-f4f5-43ba-8b0f-dcc96338f4e6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:38.962462 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6b79e171-f4f5-43ba-8b0f-dcc96338f4e6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:38.969412 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-6b79e171-f4f5-43ba-8b0f-dcc96338f4e6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 200 len: 1237 microversion: 2.1 time: 0.066798 Sep 05 12:40:38.970015 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 571/1124] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:38 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:39.993476 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-002a39b6-5c92-41c4-8d67-58417268d6bb tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:39.994146 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-002a39b6-5c92-41c4-8d67-58417268d6bb tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:40.056763 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-002a39b6-5c92-41c4-8d67-58417268d6bb tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:40.066364 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-002a39b6-5c92-41c4-8d67-58417268d6bb tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 200 len: 1237 microversion: 2.1 time: 0.076008 Sep 05 12:40:40.067997 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 554/1125] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:39 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 1237 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:41.087609 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-2d4295b9-075e-4a7a-a905-74372ac4af0c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:41.088227 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-2d4295b9-075e-4a7a-a905-74372ac4af0c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:41.139815 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-2d4295b9-075e-4a7a-a905-74372ac4af0c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:41.147493 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-2d4295b9-075e-4a7a-a905-74372ac4af0c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 200 len: 1237 microversion: 2.1 time: 0.063869 Sep 05 12:40:41.148104 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 572/1126] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:41 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 1237 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:42.172398 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-17f5760a-bb68-49be-ac0d-97d255905268 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:42.173090 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-17f5760a-bb68-49be-ac0d-97d255905268 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:42.228073 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-17f5760a-bb68-49be-ac0d-97d255905268 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:42.235172 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-17f5760a-bb68-49be-ac0d-97d255905268 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 200 len: 1237 microversion: 2.1 time: 0.066806 Sep 05 12:40:42.235784 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 555/1127] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:42 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:43.258399 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e8fa85fa-1dd8-4fe9-8f0c-a1adf5f0d349 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:43.258934 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e8fa85fa-1dd8-4fe9-8f0c-a1adf5f0d349 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:43.265314 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8fa85fa-1dd8-4fe9-8f0c-a1adf5f0d349 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:43.265802 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8fa85fa-1dd8-4fe9-8f0c-a1adf5f0d349 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:43.266238 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8fa85fa-1dd8-4fe9-8f0c-a1adf5f0d349 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:43.266928 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8fa85fa-1dd8-4fe9-8f0c-a1adf5f0d349 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:43.267386 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8fa85fa-1dd8-4fe9-8f0c-a1adf5f0d349 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:43.267843 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8fa85fa-1dd8-4fe9-8f0c-a1adf5f0d349 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:43.327315 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e8fa85fa-1dd8-4fe9-8f0c-a1adf5f0d349 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:43.334847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e8fa85fa-1dd8-4fe9-8f0c-a1adf5f0d349 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 200 len: 1241 microversion: 2.1 time: 0.080483 Sep 05 12:40:43.335406 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 573/1128] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:43 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:44.358525 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-77d62239-e39b-4266-afd3-a098df5bc403 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:44.359528 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-77d62239-e39b-4266-afd3-a098df5bc403 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:44.366775 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-77d62239-e39b-4266-afd3-a098df5bc403 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:44.367426 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-77d62239-e39b-4266-afd3-a098df5bc403 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:44.368070 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-77d62239-e39b-4266-afd3-a098df5bc403 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:44.368992 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-77d62239-e39b-4266-afd3-a098df5bc403 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:44.369553 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-77d62239-e39b-4266-afd3-a098df5bc403 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:44.370097 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-77d62239-e39b-4266-afd3-a098df5bc403 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:44.433881 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-77d62239-e39b-4266-afd3-a098df5bc403 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:44.442314 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-77d62239-e39b-4266-afd3-a098df5bc403 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 200 len: 1233 microversion: 2.1 time: 0.088464 Sep 05 12:40:44.442886 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 556/1129] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:44 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 1233 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:45.466626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-daffdcb5-620e-4a58-95e0-4113179c6586 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:45.468167 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-daffdcb5-620e-4a58-95e0-4113179c6586 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:45.475771 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-daffdcb5-620e-4a58-95e0-4113179c6586 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:45.476251 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-daffdcb5-620e-4a58-95e0-4113179c6586 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:45.476692 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-daffdcb5-620e-4a58-95e0-4113179c6586 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:45.477415 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-daffdcb5-620e-4a58-95e0-4113179c6586 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:45.477901 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-daffdcb5-620e-4a58-95e0-4113179c6586 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:45.478330 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-daffdcb5-620e-4a58-95e0-4113179c6586 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:45.542055 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-daffdcb5-620e-4a58-95e0-4113179c6586 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:45.550803 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-daffdcb5-620e-4a58-95e0-4113179c6586 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 200 len: 1307 microversion: 2.1 time: 0.088146 Sep 05 12:40:45.551384 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 574/1130] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:45 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 1307 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:46.574456 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-522e88e3-7d85-48a4-8901-84ef7885017d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:46.575101 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-522e88e3-7d85-48a4-8901-84ef7885017d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:46.582430 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-522e88e3-7d85-48a4-8901-84ef7885017d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:46.582914 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-522e88e3-7d85-48a4-8901-84ef7885017d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:46.583347 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-522e88e3-7d85-48a4-8901-84ef7885017d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:46.584085 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-522e88e3-7d85-48a4-8901-84ef7885017d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:46.584542 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-522e88e3-7d85-48a4-8901-84ef7885017d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:46.584966 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-522e88e3-7d85-48a4-8901-84ef7885017d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:46.724492 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-522e88e3-7d85-48a4-8901-84ef7885017d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:46.732441 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-522e88e3-7d85-48a4-8901-84ef7885017d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 200 len: 1363 microversion: 2.1 time: 0.162021 Sep 05 12:40:46.733018 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 557/1131] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:46 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:46.932467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-78bc68c5-188a-4ee9-8fda-e64317924f05 req-9756f186-bba0-46c2-8afa-1833715bdb66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74b8a4c9-d32d-4ae8-8c35-2093b6254310", "tag": "747d4629-7b76-4789-94ee-f0c092606077"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:40:46.938774 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:46.942941 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-78bc68c5-188a-4ee9-8fda-e64317924f05 req-9756f186-bba0-46c2-8afa-1833715bdb66 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:46.943422 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-78bc68c5-188a-4ee9-8fda-e64317924f05 req-9756f186-bba0-46c2-8afa-1833715bdb66 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:46.943880 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-78bc68c5-188a-4ee9-8fda-e64317924f05 req-9756f186-bba0-46c2-8afa-1833715bdb66 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:46.955850 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-78bc68c5-188a-4ee9-8fda-e64317924f05 req-9756f186-bba0-46c2-8afa-1833715bdb66 service nova] Creating event network-changed:747d4629-7b76-4789-94ee-f0c092606077 for instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 on hv-cinder-80135 Sep 05 12:40:46.961589 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-78bc68c5-188a-4ee9-8fda-e64317924f05 req-9756f186-bba0-46c2-8afa-1833715bdb66 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032761 Sep 05 12:40:46.961589 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 575/1132] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:40:47.758773 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ea528f25-37b9-4183-b066-cf7bb056c6cd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:47.759328 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-ea528f25-37b9-4183-b066-cf7bb056c6cd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:47.766007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ea528f25-37b9-4183-b066-cf7bb056c6cd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:47.766548 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ea528f25-37b9-4183-b066-cf7bb056c6cd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:47.766937 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ea528f25-37b9-4183-b066-cf7bb056c6cd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:47.767759 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ea528f25-37b9-4183-b066-cf7bb056c6cd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:47.768149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ea528f25-37b9-4183-b066-cf7bb056c6cd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:47.768582 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ea528f25-37b9-4183-b066-cf7bb056c6cd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:47.899343 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-ea528f25-37b9-4183-b066-cf7bb056c6cd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:47.907466 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-ea528f25-37b9-4183-b066-cf7bb056c6cd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 200 len: 1363 microversion: 2.1 time: 0.152410 Sep 05 12:40:47.908062 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 558/1133] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:47 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:48.933723 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-3a617982-4033-447d-ba56-a52a12309acb tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:48.934341 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-3a617982-4033-447d-ba56-a52a12309acb tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:48.941257 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3a617982-4033-447d-ba56-a52a12309acb tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:48.941748 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3a617982-4033-447d-ba56-a52a12309acb tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:48.942192 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3a617982-4033-447d-ba56-a52a12309acb tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:48.942902 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3a617982-4033-447d-ba56-a52a12309acb tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:48.943428 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3a617982-4033-447d-ba56-a52a12309acb tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:48.943890 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-3a617982-4033-447d-ba56-a52a12309acb tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:49.079973 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-3a617982-4033-447d-ba56-a52a12309acb tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:49.082407 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=1 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:49.088848 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-3a617982-4033-447d-ba56-a52a12309acb tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 200 len: 1363 microversion: 2.1 time: 0.160366 Sep 05 12:40:49.089439 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 576/1134] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:48 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:50.111861 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-6768a5aa-16b5-428c-85fb-9a7669ac40e0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:50.112466 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-6768a5aa-16b5-428c-85fb-9a7669ac40e0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:50.115752 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=2 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:50.116938 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:50.120320 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6768a5aa-16b5-428c-85fb-9a7669ac40e0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:50.120800 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6768a5aa-16b5-428c-85fb-9a7669ac40e0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:50.121227 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6768a5aa-16b5-428c-85fb-9a7669ac40e0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:50.121920 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6768a5aa-16b5-428c-85fb-9a7669ac40e0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:50.122364 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6768a5aa-16b5-428c-85fb-9a7669ac40e0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:50.122781 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-6768a5aa-16b5-428c-85fb-9a7669ac40e0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:50.127663 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:50.264820 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-6768a5aa-16b5-428c-85fb-9a7669ac40e0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:50.277023 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-6768a5aa-16b5-428c-85fb-9a7669ac40e0 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 200 len: 1363 microversion: 2.1 time: 0.168818 Sep 05 12:40:50.277871 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 559/1135] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:50 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:51.305704 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-aa20a3fb-4885-415f-af14-9becdd242276 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:51.306255 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-aa20a3fb-4885-415f-af14-9becdd242276 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:51.308502 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=8 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:51.314624 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa20a3fb-4885-415f-af14-9becdd242276 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:51.315147 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa20a3fb-4885-415f-af14-9becdd242276 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:51.317141 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa20a3fb-4885-415f-af14-9becdd242276 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:51.317141 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa20a3fb-4885-415f-af14-9becdd242276 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:51.317141 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa20a3fb-4885-415f-af14-9becdd242276 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:51.317871 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa20a3fb-4885-415f-af14-9becdd242276 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:51.460564 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-aa20a3fb-4885-415f-af14-9becdd242276 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:51.468260 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-aa20a3fb-4885-415f-af14-9becdd242276 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 200 len: 1363 microversion: 2.1 time: 0.166925 Sep 05 12:40:51.468888 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 577/1136] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:51 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:52.491971 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-2a34cf82-6dd4-4e82-89e6-cb9388a200b1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:52.494065 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-2a34cf82-6dd4-4e82-89e6-cb9388a200b1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:52.495469 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=10 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:52.501415 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2a34cf82-6dd4-4e82-89e6-cb9388a200b1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:52.501905 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2a34cf82-6dd4-4e82-89e6-cb9388a200b1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:52.502396 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2a34cf82-6dd4-4e82-89e6-cb9388a200b1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:52.503359 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2a34cf82-6dd4-4e82-89e6-cb9388a200b1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:52.504022 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2a34cf82-6dd4-4e82-89e6-cb9388a200b1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:52.504457 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-2a34cf82-6dd4-4e82-89e6-cb9388a200b1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:52.647493 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-2a34cf82-6dd4-4e82-89e6-cb9388a200b1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:52.664212 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-2a34cf82-6dd4-4e82-89e6-cb9388a200b1 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 200 len: 1363 microversion: 2.1 time: 0.176048 Sep 05 12:40:52.664846 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 560/1137] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:52 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:52.713524 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-f76a0afa-7270-4381-97bb-8165466faa4e req-cd0215b5-0f5e-4d02-9810-ce844a4d513e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b8a4c9-d32d-4ae8-8c35-2093b6254310", "name": "network-vif-plugged", "status": "completed", "tag": "747d4629-7b76-4789-94ee-f0c092606077"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:40:52.723402 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-f76a0afa-7270-4381-97bb-8165466faa4e req-cd0215b5-0f5e-4d02-9810-ce844a4d513e service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:52.723912 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-f76a0afa-7270-4381-97bb-8165466faa4e req-cd0215b5-0f5e-4d02-9810-ce844a4d513e service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:52.724340 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-f76a0afa-7270-4381-97bb-8165466faa4e req-cd0215b5-0f5e-4d02-9810-ce844a4d513e service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:52.735158 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-f76a0afa-7270-4381-97bb-8165466faa4e req-cd0215b5-0f5e-4d02-9810-ce844a4d513e service nova] Creating event network-vif-plugged:747d4629-7b76-4789-94ee-f0c092606077 for instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 on hv-cinder-80135 Sep 05 12:40:52.740163 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-f76a0afa-7270-4381-97bb-8165466faa4e req-cd0215b5-0f5e-4d02-9810-ce844a4d513e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236084 Sep 05 12:40:52.740770 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 578/1138] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:40:53.689869 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d06cf72e-9a5b-4539-9e75-4c89c71cb1c8 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:53.690459 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d06cf72e-9a5b-4539-9e75-4c89c71cb1c8 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:53.697916 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d06cf72e-9a5b-4539-9e75-4c89c71cb1c8 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:53.698396 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d06cf72e-9a5b-4539-9e75-4c89c71cb1c8 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:53.698822 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d06cf72e-9a5b-4539-9e75-4c89c71cb1c8 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:53.699513 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d06cf72e-9a5b-4539-9e75-4c89c71cb1c8 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:53.700013 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d06cf72e-9a5b-4539-9e75-4c89c71cb1c8 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:53.700408 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d06cf72e-9a5b-4539-9e75-4c89c71cb1c8 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:53.834775 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d06cf72e-9a5b-4539-9e75-4c89c71cb1c8 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:53.842539 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d06cf72e-9a5b-4539-9e75-4c89c71cb1c8 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 200 len: 1363 microversion: 2.1 time: 0.157635 Sep 05 12:40:53.843120 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 561/1139] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:53 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:54.867244 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8a48471d-0387-4dbb-aaac-3ec7b5738f14 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:54.867967 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-8a48471d-0387-4dbb-aaac-3ec7b5738f14 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:54.874086 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8a48471d-0387-4dbb-aaac-3ec7b5738f14 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:54.874565 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8a48471d-0387-4dbb-aaac-3ec7b5738f14 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:54.875002 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8a48471d-0387-4dbb-aaac-3ec7b5738f14 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:54.875725 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8a48471d-0387-4dbb-aaac-3ec7b5738f14 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:54.876185 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8a48471d-0387-4dbb-aaac-3ec7b5738f14 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:54.876611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8a48471d-0387-4dbb-aaac-3ec7b5738f14 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:55.013639 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-8a48471d-0387-4dbb-aaac-3ec7b5738f14 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:55.023027 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-8a48471d-0387-4dbb-aaac-3ec7b5738f14 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 200 len: 1363 microversion: 2.1 time: 0.160452 Sep 05 12:40:55.023629 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 579/1140] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:54 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:56.049709 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-498b4dec-6102-4472-9993-746ba255b450 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:56.050326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-498b4dec-6102-4472-9993-746ba255b450 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:56.056705 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-498b4dec-6102-4472-9993-746ba255b450 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:56.057187 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-498b4dec-6102-4472-9993-746ba255b450 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:56.057618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-498b4dec-6102-4472-9993-746ba255b450 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:56.058314 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-498b4dec-6102-4472-9993-746ba255b450 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:56.058768 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-498b4dec-6102-4472-9993-746ba255b450 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:56.059189 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-498b4dec-6102-4472-9993-746ba255b450 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:56.188307 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-498b4dec-6102-4472-9993-746ba255b450 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:40:56.196228 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-498b4dec-6102-4472-9993-746ba255b450 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 200 len: 1549 microversion: 2.1 time: 0.150956 Sep 05 12:40:56.196784 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 562/1141] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:40:56 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:40:56.218468 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-311a349e-ee70-4c32-b7aa-81574951d46d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:40:56.218998 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-311a349e-ee70-4c32-b7aa-81574951d46d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:40:56.225926 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-311a349e-ee70-4c32-b7aa-81574951d46d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:56.226408 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-311a349e-ee70-4c32-b7aa-81574951d46d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:56.226934 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-311a349e-ee70-4c32-b7aa-81574951d46d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:56.227593 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-311a349e-ee70-4c32-b7aa-81574951d46d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:56.228017 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-311a349e-ee70-4c32-b7aa-81574951d46d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:56.228438 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-311a349e-ee70-4c32-b7aa-81574951d46d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:56.306515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-311a349e-ee70-4c32-b7aa-81574951d46d tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091959 Sep 05 12:40:56.307109 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 580/1142] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Sep 5 12:40:56 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:40:57.565390 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-437586f0-54c4-44bd-8b09-25e3fd658b01 req-a7c3032c-fce5-4dcb-9fc1-71dd322dfd2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74b8a4c9-d32d-4ae8-8c35-2093b6254310", "tag": "747d4629-7b76-4789-94ee-f0c092606077"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:40:57.575221 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-437586f0-54c4-44bd-8b09-25e3fd658b01 req-a7c3032c-fce5-4dcb-9fc1-71dd322dfd2a service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:40:57.575735 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-437586f0-54c4-44bd-8b09-25e3fd658b01 req-a7c3032c-fce5-4dcb-9fc1-71dd322dfd2a service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:40:57.576165 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-437586f0-54c4-44bd-8b09-25e3fd658b01 req-a7c3032c-fce5-4dcb-9fc1-71dd322dfd2a service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:40:57.587117 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-437586f0-54c4-44bd-8b09-25e3fd658b01 req-a7c3032c-fce5-4dcb-9fc1-71dd322dfd2a service nova] Creating event network-changed:747d4629-7b76-4789-94ee-f0c092606077 for instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 on hv-cinder-80135 Sep 05 12:40:57.592180 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-437586f0-54c4-44bd-8b09-25e3fd658b01 req-a7c3032c-fce5-4dcb-9fc1-71dd322dfd2a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030984 Sep 05 12:40:57.593323 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 563/1143] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:41:35.652707 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=11 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:41:35.653395 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=19 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:41:35.654644 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 12:41:35.654794 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Mon Sep 5 12:41:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/ips (ip 10.222.0.62) !!! Sep 05 12:41:35.661471 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e8e6ef0e-ad15-4656-ba89-29b5a93cc153 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:41:35.664880 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e8e6ef0e-ad15-4656-ba89-29b5a93cc153 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:41:35.669788 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8e6ef0e-ad15-4656-ba89-29b5a93cc153 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:35.670278 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8e6ef0e-ad15-4656-ba89-29b5a93cc153 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:35.670708 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8e6ef0e-ad15-4656-ba89-29b5a93cc153 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:35.671401 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8e6ef0e-ad15-4656-ba89-29b5a93cc153 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:35.671887 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8e6ef0e-ad15-4656-ba89-29b5a93cc153 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:35.672313 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8e6ef0e-ad15-4656-ba89-29b5a93cc153 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:35.695404 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e8e6ef0e-ad15-4656-ba89-29b5a93cc153 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/ips" status: 200 len: 146 microversion: 2.1 time: 0.044331 Sep 05 12:41:35.696007 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 581/1144] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Sep 5 12:41:35 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:41:37.178875 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=9 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:41:37.179646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=25 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:41:37.184349 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-eac02ff8-6802-4f04-9e21-091b89a2ca21 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1460dba9-f2e0-422f-a004-8799bb2364dc"}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:41:37.186814 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-eac02ff8-6802-4f04-9e21-091b89a2ca21 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:41:37.193085 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-eac02ff8-6802-4f04-9e21-091b89a2ca21 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:37.197934 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-eac02ff8-6802-4f04-9e21-091b89a2ca21 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:37.197934 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-eac02ff8-6802-4f04-9e21-091b89a2ca21 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:37.197934 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-eac02ff8-6802-4f04-9e21-091b89a2ca21 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:37.197934 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-eac02ff8-6802-4f04-9e21-091b89a2ca21 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:37.198289 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-eac02ff8-6802-4f04-9e21-091b89a2ca21 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:37.928262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-eac02ff8-6802-4f04-9e21-091b89a2ca21 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "POST /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.750510 Sep 05 12:41:37.928865 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 564/1145] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Sep 5 12:41:37 2022] POST /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments => generated 194 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:41:45.456172 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-05d1b237-7550-4e7b-a8ae-9233509ceb7a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:41:45.458464 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-05d1b237-7550-4e7b-a8ae-9233509ceb7a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:41:45.469175 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-05d1b237-7550-4e7b-a8ae-9233509ceb7a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:45.469668 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-05d1b237-7550-4e7b-a8ae-9233509ceb7a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:45.473913 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-05d1b237-7550-4e7b-a8ae-9233509ceb7a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:45.474801 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-05d1b237-7550-4e7b-a8ae-9233509ceb7a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:45.475321 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-05d1b237-7550-4e7b-a8ae-9233509ceb7a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:45.475872 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-05d1b237-7550-4e7b-a8ae-9233509ceb7a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:45.506593 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-05d1b237-7550-4e7b-a8ae-9233509ceb7a tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054582 Sep 05 12:41:45.507142 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 582/1146] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:41:45 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:41:45.519078 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a51436e2-7568-4b43-9e59-bbd8c62d6a16 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:41:45.519653 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a51436e2-7568-4b43-9e59-bbd8c62d6a16 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:41:45.525815 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a51436e2-7568-4b43-9e59-bbd8c62d6a16 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:45.526294 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a51436e2-7568-4b43-9e59-bbd8c62d6a16 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:45.526750 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a51436e2-7568-4b43-9e59-bbd8c62d6a16 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:45.527435 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a51436e2-7568-4b43-9e59-bbd8c62d6a16 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:45.527907 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a51436e2-7568-4b43-9e59-bbd8c62d6a16 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:45.532210 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a51436e2-7568-4b43-9e59-bbd8c62d6a16 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:45.557490 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a51436e2-7568-4b43-9e59-bbd8c62d6a16 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments/1460dba9-f2e0-422f-a004-8799bb2364dc" status: 200 len: 194 microversion: 2.1 time: 0.043237 Sep 05 12:41:45.558056 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 565/1147] 10.222.0.62 () {58 vars in 1413 bytes} [Mon Sep 5 12:41:45 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments/1460dba9-f2e0-422f-a004-8799bb2364dc => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:41:47.243921 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a5fd0be6-9455-4b15-a96c-659378843f6e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "887be216-2eab-4aa3-8967-210bfe92d316"}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:41:47.246262 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a5fd0be6-9455-4b15-a96c-659378843f6e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:41:47.252931 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a5fd0be6-9455-4b15-a96c-659378843f6e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:47.253410 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a5fd0be6-9455-4b15-a96c-659378843f6e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:47.253839 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a5fd0be6-9455-4b15-a96c-659378843f6e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:47.254514 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a5fd0be6-9455-4b15-a96c-659378843f6e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:47.254960 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a5fd0be6-9455-4b15-a96c-659378843f6e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:47.255378 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a5fd0be6-9455-4b15-a96c-659378843f6e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:48.128411 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a5fd0be6-9455-4b15-a96c-659378843f6e tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "POST /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.888251 Sep 05 12:41:48.129056 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 583/1148] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Sep 5 12:41:47 2022] POST /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments => generated 194 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:41:56.711115 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-437fbe7c-1042-48a0-b8be-7a5f7ee251d5 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:41:56.713306 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-437fbe7c-1042-48a0-b8be-7a5f7ee251d5 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:41:56.716007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=4 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:41:56.716659 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:41:56.721252 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-437fbe7c-1042-48a0-b8be-7a5f7ee251d5 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:56.721725 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-437fbe7c-1042-48a0-b8be-7a5f7ee251d5 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:56.722162 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-437fbe7c-1042-48a0-b8be-7a5f7ee251d5 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:56.722884 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-437fbe7c-1042-48a0-b8be-7a5f7ee251d5 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:56.723331 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-437fbe7c-1042-48a0-b8be-7a5f7ee251d5 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:56.723778 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-437fbe7c-1042-48a0-b8be-7a5f7ee251d5 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:56.754035 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-437fbe7c-1042-48a0-b8be-7a5f7ee251d5 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046914 Sep 05 12:41:56.754590 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 566/1149] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:41:56 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:41:56.921290 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d28282c1-ae4b-4ddf-a33d-cec6981de4cd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:41:56.921838 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d28282c1-ae4b-4ddf-a33d-cec6981de4cd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:41:56.927894 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d28282c1-ae4b-4ddf-a33d-cec6981de4cd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:56.928370 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d28282c1-ae4b-4ddf-a33d-cec6981de4cd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:56.928800 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d28282c1-ae4b-4ddf-a33d-cec6981de4cd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:56.929477 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d28282c1-ae4b-4ddf-a33d-cec6981de4cd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:56.929921 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d28282c1-ae4b-4ddf-a33d-cec6981de4cd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:56.930337 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d28282c1-ae4b-4ddf-a33d-cec6981de4cd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:56.959597 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d28282c1-ae4b-4ddf-a33d-cec6981de4cd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments/1460dba9-f2e0-422f-a004-8799bb2364dc" status: 200 len: 194 microversion: 2.1 time: 0.043277 Sep 05 12:41:56.960163 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 584/1150] 10.222.0.62 () {58 vars in 1413 bytes} [Mon Sep 5 12:41:56 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments/1460dba9-f2e0-422f-a004-8799bb2364dc => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:41:56.970949 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-318fd77f-1742-4837-ad91-96c3ebf17014 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:41:56.971442 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-318fd77f-1742-4837-ad91-96c3ebf17014 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:41:56.977717 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-318fd77f-1742-4837-ad91-96c3ebf17014 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:56.978198 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-318fd77f-1742-4837-ad91-96c3ebf17014 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:56.978631 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-318fd77f-1742-4837-ad91-96c3ebf17014 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:56.979312 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-318fd77f-1742-4837-ad91-96c3ebf17014 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:56.979786 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-318fd77f-1742-4837-ad91-96c3ebf17014 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:56.980207 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-318fd77f-1742-4837-ad91-96c3ebf17014 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:57.067149 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-318fd77f-1742-4837-ad91-96c3ebf17014 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lazy-loading 'services' on Instance uuid 74b8a4c9-d32d-4ae8-8c35-2093b6254310 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:41:57.282495 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-318fd77f-1742-4837-ad91-96c3ebf17014 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "DELETE /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments/1460dba9-f2e0-422f-a004-8799bb2364dc" status: 202 len: 0 microversion: 2.1 time: 0.315633 Sep 05 12:41:57.283075 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 567/1151] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Sep 5 12:41:56 2022] DELETE /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments/1460dba9-f2e0-422f-a004-8799bb2364dc => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:41:59.458108 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c2eab44d-3786-46fc-9f84-6c5d8715ad11 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:41:59.458636 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-c2eab44d-3786-46fc-9f84-6c5d8715ad11 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:41:59.465214 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c2eab44d-3786-46fc-9f84-6c5d8715ad11 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:59.465699 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c2eab44d-3786-46fc-9f84-6c5d8715ad11 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:59.466137 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c2eab44d-3786-46fc-9f84-6c5d8715ad11 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:59.466879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c2eab44d-3786-46fc-9f84-6c5d8715ad11 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:59.467343 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c2eab44d-3786-46fc-9f84-6c5d8715ad11 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:59.467801 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c2eab44d-3786-46fc-9f84-6c5d8715ad11 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:59.496335 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-c2eab44d-3786-46fc-9f84-6c5d8715ad11 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments/887be216-2eab-4aa3-8967-210bfe92d316" status: 200 len: 194 microversion: 2.1 time: 0.042656 Sep 05 12:41:59.496911 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 585/1152] 10.222.0.62 () {58 vars in 1413 bytes} [Mon Sep 5 12:41:59 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments/887be216-2eab-4aa3-8967-210bfe92d316 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:41:59.508758 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1897b22f-3ac8-4613-92c5-d25f794ed218 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:41:59.509343 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1897b22f-3ac8-4613-92c5-d25f794ed218 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:41:59.515709 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1897b22f-3ac8-4613-92c5-d25f794ed218 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:59.516190 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1897b22f-3ac8-4613-92c5-d25f794ed218 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:59.516659 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1897b22f-3ac8-4613-92c5-d25f794ed218 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:59.517338 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1897b22f-3ac8-4613-92c5-d25f794ed218 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:41:59.517785 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1897b22f-3ac8-4613-92c5-d25f794ed218 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:41:59.518198 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1897b22f-3ac8-4613-92c5-d25f794ed218 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:41:59.599867 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-1897b22f-3ac8-4613-92c5-d25f794ed218 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lazy-loading 'services' on Instance uuid 74b8a4c9-d32d-4ae8-8c35-2093b6254310 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:41:59.779512 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1897b22f-3ac8-4613-92c5-d25f794ed218 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "DELETE /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments/887be216-2eab-4aa3-8967-210bfe92d316" status: 202 len: 0 microversion: 2.1 time: 0.275430 Sep 05 12:41:59.780117 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 568/1153] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Sep 5 12:41:59 2022] DELETE /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments/887be216-2eab-4aa3-8967-210bfe92d316 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:42:02.147307 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-9849afe4-2f9e-4785-b8a5-4cad7ea637ba tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:02.149495 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-9849afe4-2f9e-4785-b8a5-4cad7ea637ba tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:02.155751 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9849afe4-2f9e-4785-b8a5-4cad7ea637ba tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:02.156228 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9849afe4-2f9e-4785-b8a5-4cad7ea637ba tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:02.156665 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9849afe4-2f9e-4785-b8a5-4cad7ea637ba tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:02.157344 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9849afe4-2f9e-4785-b8a5-4cad7ea637ba tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:02.157788 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9849afe4-2f9e-4785-b8a5-4cad7ea637ba tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:02.158206 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-9849afe4-2f9e-4785-b8a5-4cad7ea637ba tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:02.186356 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-9849afe4-2f9e-4785-b8a5-4cad7ea637ba tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043628 Sep 05 12:42:02.186906 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 586/1154] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:42:02 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 12:42:02.300284 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-aadfa26a-670c-4035-bf8a-c395a5597ec9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:02.303114 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-aadfa26a-670c-4035-bf8a-c395a5597ec9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:02.309692 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aadfa26a-670c-4035-bf8a-c395a5597ec9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:02.310171 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aadfa26a-670c-4035-bf8a-c395a5597ec9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:02.310606 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aadfa26a-670c-4035-bf8a-c395a5597ec9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:02.311283 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aadfa26a-670c-4035-bf8a-c395a5597ec9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:02.311798 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aadfa26a-670c-4035-bf8a-c395a5597ec9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:02.312219 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-aadfa26a-670c-4035-bf8a-c395a5597ec9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:02.340727 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-aadfa26a-670c-4035-bf8a-c395a5597ec9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044716 Sep 05 12:42:02.341267 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 569/1155] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Sep 5 12:42:02 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 12:42:02.404196 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-20b3d8b4-e383-4d62-bb49-6fd27c6c2823 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:02.404691 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-20b3d8b4-e383-4d62-bb49-6fd27c6c2823 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:02.410488 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-20b3d8b4-e383-4d62-bb49-6fd27c6c2823 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:02.410959 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-20b3d8b4-e383-4d62-bb49-6fd27c6c2823 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:02.411388 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-20b3d8b4-e383-4d62-bb49-6fd27c6c2823 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:02.412089 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-20b3d8b4-e383-4d62-bb49-6fd27c6c2823 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:02.412539 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-20b3d8b4-e383-4d62-bb49-6fd27c6c2823 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:02.412957 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-20b3d8b4-e383-4d62-bb49-6fd27c6c2823 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:02.436975 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-20b3d8b4-e383-4d62-bb49-6fd27c6c2823 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Going to try to terminate instance {{(pid=121211) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:42:02.711135 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-20b3d8b4-e383-4d62-bb49-6fd27c6c2823 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "DELETE /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 204 len: 0 microversion: 2.1 time: 0.310319 Sep 05 12:42:02.711684 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 587/1156] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:42:02 2022] DELETE /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:42:02.726275 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-978931c1-c50d-4dd2-8c44-2e3ecfc06760 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:02.726905 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-978931c1-c50d-4dd2-8c44-2e3ecfc06760 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:02.732825 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-978931c1-c50d-4dd2-8c44-2e3ecfc06760 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:02.733297 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-978931c1-c50d-4dd2-8c44-2e3ecfc06760 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:02.733722 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-978931c1-c50d-4dd2-8c44-2e3ecfc06760 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:02.734399 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-978931c1-c50d-4dd2-8c44-2e3ecfc06760 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:02.734841 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-978931c1-c50d-4dd2-8c44-2e3ecfc06760 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:02.735257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-978931c1-c50d-4dd2-8c44-2e3ecfc06760 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:02.864709 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-978931c1-c50d-4dd2-8c44-2e3ecfc06760 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:42:02.873031 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-978931c1-c50d-4dd2-8c44-2e3ecfc06760 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 200 len: 1674 microversion: 2.1 time: 0.151108 Sep 05 12:42:02.873586 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 570/1157] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:42:02 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:42:03.896919 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-95d1a0a1-84ee-4040-9942-0402d456c3c6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:03.897626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-95d1a0a1-84ee-4040-9942-0402d456c3c6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:03.904039 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-95d1a0a1-84ee-4040-9942-0402d456c3c6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:03.904522 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-95d1a0a1-84ee-4040-9942-0402d456c3c6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:03.904955 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-95d1a0a1-84ee-4040-9942-0402d456c3c6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:03.905638 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-95d1a0a1-84ee-4040-9942-0402d456c3c6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:03.906120 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-95d1a0a1-84ee-4040-9942-0402d456c3c6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:03.906543 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-95d1a0a1-84ee-4040-9942-0402d456c3c6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:04.037102 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-95d1a0a1-84ee-4040-9942-0402d456c3c6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:42:04.044899 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-95d1a0a1-84ee-4040-9942-0402d456c3c6 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 200 len: 1674 microversion: 2.1 time: 0.152149 Sep 05 12:42:04.045484 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 588/1158] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:42:03 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:42:05.069449 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-87ba58d9-273c-4d96-b400-3753a16a07a2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:05.070057 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-87ba58d9-273c-4d96-b400-3753a16a07a2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:05.076748 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-87ba58d9-273c-4d96-b400-3753a16a07a2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:05.077227 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-87ba58d9-273c-4d96-b400-3753a16a07a2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:05.077654 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-87ba58d9-273c-4d96-b400-3753a16a07a2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:05.078351 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-87ba58d9-273c-4d96-b400-3753a16a07a2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:05.078831 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-87ba58d9-273c-4d96-b400-3753a16a07a2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:05.079253 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-87ba58d9-273c-4d96-b400-3753a16a07a2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:05.213406 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-87ba58d9-273c-4d96-b400-3753a16a07a2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:42:05.221581 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-87ba58d9-273c-4d96-b400-3753a16a07a2 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 200 len: 1674 microversion: 2.1 time: 0.156464 Sep 05 12:42:05.222088 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 571/1159] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:42:05 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:42:05.853363 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-6a69db2c-ea1e-4d5a-9bba-6c52645b9c52 req-c18e6c94-4c27-44f6-ae87-ea29a45c513d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b8a4c9-d32d-4ae8-8c35-2093b6254310", "name": "network-vif-deleted", "tag": "747d4629-7b76-4789-94ee-f0c092606077"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:42:05.858879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:42:05.864176 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-6a69db2c-ea1e-4d5a-9bba-6c52645b9c52 req-c18e6c94-4c27-44f6-ae87-ea29a45c513d service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:05.865049 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-6a69db2c-ea1e-4d5a-9bba-6c52645b9c52 req-c18e6c94-4c27-44f6-ae87-ea29a45c513d service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:05.865049 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-6a69db2c-ea1e-4d5a-9bba-6c52645b9c52 req-c18e6c94-4c27-44f6-ae87-ea29a45c513d service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:05.876641 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-6a69db2c-ea1e-4d5a-9bba-6c52645b9c52 req-c18e6c94-4c27-44f6-ae87-ea29a45c513d service nova] Creating event network-vif-deleted:747d4629-7b76-4789-94ee-f0c092606077 for instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 on hv-cinder-80135 Sep 05 12:42:05.882247 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-6a69db2c-ea1e-4d5a-9bba-6c52645b9c52 req-c18e6c94-4c27-44f6-ae87-ea29a45c513d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032516 Sep 05 12:42:05.882840 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 589/1160] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:42:06.245468 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7385b31b-5366-4bd5-bdbf-2018263820c9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:06.246161 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-7385b31b-5366-4bd5-bdbf-2018263820c9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:06.252934 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7385b31b-5366-4bd5-bdbf-2018263820c9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:06.253412 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7385b31b-5366-4bd5-bdbf-2018263820c9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:06.253871 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7385b31b-5366-4bd5-bdbf-2018263820c9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:06.254566 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7385b31b-5366-4bd5-bdbf-2018263820c9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:06.255012 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7385b31b-5366-4bd5-bdbf-2018263820c9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:06.255427 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7385b31b-5366-4bd5-bdbf-2018263820c9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:06.287767 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7385b31b-5366-4bd5-bdbf-2018263820c9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:06.288247 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7385b31b-5366-4bd5-bdbf-2018263820c9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:06.288672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7385b31b-5366-4bd5-bdbf-2018263820c9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:06.289299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-7385b31b-5366-4bd5-bdbf-2018263820c9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lazy-loading 'fault' on Instance uuid 74b8a4c9-d32d-4ae8-8c35-2093b6254310 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:42:06.330422 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-7385b31b-5366-4bd5-bdbf-2018263820c9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb013575d540c59121ac8a1613fc0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b514c04a13742b1b19d46fec1c40f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:42:06.338070 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-7385b31b-5366-4bd5-bdbf-2018263820c9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 200 len: 1327 microversion: 2.1 time: 0.097272 Sep 05 12:42:06.338639 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 572/1161] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:42:06 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:42:07.362389 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7444257c-d7ff-4613-9b7a-cf51c2bfafdd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:07.363002 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-7444257c-d7ff-4613-9b7a-cf51c2bfafdd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:07.369665 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7444257c-d7ff-4613-9b7a-cf51c2bfafdd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:07.370143 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7444257c-d7ff-4613-9b7a-cf51c2bfafdd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:07.370577 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7444257c-d7ff-4613-9b7a-cf51c2bfafdd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:07.371264 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7444257c-d7ff-4613-9b7a-cf51c2bfafdd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:07.371782 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7444257c-d7ff-4613-9b7a-cf51c2bfafdd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:07.372209 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-7444257c-d7ff-4613-9b7a-cf51c2bfafdd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:07.385909 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-7444257c-d7ff-4613-9b7a-cf51c2bfafdd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] HTTP exception thrown: Instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 could not be found. Sep 05 12:42:07.387515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7444257c-d7ff-4613-9b7a-cf51c2bfafdd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Request method failure captured: Sep 05 12:42:07.387515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 HTTP/1.1 Sep 05 12:42:07.387515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:42:07.387515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:42:07.387515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:42:07.387515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:42:07.387515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:42:07.387515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:42:07.387515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:42:07.387515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:42:07.387515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFe1tu5Jocwz5yIpNgejJjZbGztBoqr5CiMAmR1A_BRIA-NNF_OfAiZoEP0zdiJlL46PHC0fPTzMJPF_OwKatz5VqEPBZgDDI-hRwtpcIgkjzlDx-XFcSPYV8JqkZs7BWflL0iqFPkYmieyeC3GekDBj9lR-DKKB2PHJlUvw7-7B-cHc Sep 05 12:42:07.387515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:42:07.387515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:42:07.387515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:42:07.387515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:42:07.387515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:42:07.387515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:42:07.387515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 7b514c04a13742b1b19d46fec1c40f69 Sep 05 12:42:07.387515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-AttachVolumeTestJSON-972329296 Sep 05 12:42:07.387515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:42:07.387515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:42:07.389205 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:42:07.389205 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-AttachVolumeTestJSON-972329296 Sep 05 12:42:07.389205 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 7b514c04a13742b1b19d46fec1c40f69 Sep 05 12:42:07.389205 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-AttachVolumeTestJSON-972329296 Sep 05 12:42:07.389205 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-AttachVolumeTestJSON-972329296-project Sep 05 12:42:07.389205 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:42:07.389205 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:42:07.389205 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: 8bfb013575d540c59121ac8a1613fc0f Sep 05 12:42:07.389205 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-AttachVolumeTestJSON-972329296-project Sep 05 12:42:07.389205 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: > Sep 05 12:42:07.389205 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 could not be found. Sep 05 12:42:07.389205 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': '74b8a4c9-d32d-4ae8-8c35-2093b6254310'} Sep 05 12:42:07.390035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:42:07.390035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:07.390035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:42:07.390035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:42:07.390035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:42:07.390035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:42:07.390035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:42:07.390035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:42:07.390035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:42:07.390035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:42:07.390035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 could not be found. Sep 05 12:42:07.390035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:07.390035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:07.390035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:07.390035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:07.390035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:07.390035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:07.390035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:42:07.390035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:42:07.390035 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:42:07.391442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:42:07.391442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:42:07.391442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:42:07.391442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:42:07.391442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:42:07.391442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:42:07.391442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:42:07.391442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 could not be found. Sep 05 12:42:07.391442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:07.391442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:07.391442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:07.391442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:07.391442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:07.391442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:07.391442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:42:07.391442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:42:07.391442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 could not be found. Sep 05 12:42:07.391442 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:07.392718 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-7444257c-d7ff-4613-9b7a-cf51c2bfafdd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Returning 404 to user: Instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:42:07.392718 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-7444257c-d7ff-4613-9b7a-cf51c2bfafdd tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 404 len: 111 microversion: 2.1 time: 0.031296 Sep 05 12:42:07.392718 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 590/1162] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:42:07 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:42:07.398356 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-8591fb7a-9b8e-4e16-8e0b-111c662d95b7 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '.version_select at 0x7fe7128d1700>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:07.689875 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-8591fb7a-9b8e-4e16-8e0b-111c662d95b7 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1122436465" status: 202 len: 0 microversion: 2.1 time: 0.295808 Sep 05 12:42:07.690381 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 573/1163] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Sep 5 12:42:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1122436465 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:42:11.232872 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-fee5037e-76bc-4405-b7e3-d2e9d8a073d9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:11.233369 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-fee5037e-76bc-4405-b7e3-d2e9d8a073d9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:11.239820 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fee5037e-76bc-4405-b7e3-d2e9d8a073d9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:11.240303 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fee5037e-76bc-4405-b7e3-d2e9d8a073d9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:11.240744 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fee5037e-76bc-4405-b7e3-d2e9d8a073d9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:11.241426 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fee5037e-76bc-4405-b7e3-d2e9d8a073d9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:11.241879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fee5037e-76bc-4405-b7e3-d2e9d8a073d9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:11.242301 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fee5037e-76bc-4405-b7e3-d2e9d8a073d9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:11.255661 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-fee5037e-76bc-4405-b7e3-d2e9d8a073d9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] HTTP exception thrown: Instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 could not be found. Sep 05 12:42:11.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-fee5037e-76bc-4405-b7e3-d2e9d8a073d9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Request method failure captured: Sep 05 12:42:11.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: DELETE /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 HTTP/1.1 Sep 05 12:42:11.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:42:11.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:42:11.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:42:11.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:42:11.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:42:11.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:42:11.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:42:11.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:42:11.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFe1tu5Jocwz5yIpNgejJjZbGztBoqr5CiMAmR1A_BRIA-NNF_OfAiZoEP0zdiJlL46PHC0fPTzMJPF_OwKatz5VqEPBZgDDI-hRwtpcIgkjzlDx-XFcSPYV8JqkZs7BWflL0iqFPkYmieyeC3GekDBj9lR-DKKB2PHJlUvw7-7B-cHc Sep 05 12:42:11.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:42:11.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:42:11.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:42:11.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:42:11.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:42:11.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:42:11.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 7b514c04a13742b1b19d46fec1c40f69 Sep 05 12:42:11.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-AttachVolumeTestJSON-972329296 Sep 05 12:42:11.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:42:11.257173 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:42:11.258765 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:42:11.258765 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-AttachVolumeTestJSON-972329296 Sep 05 12:42:11.258765 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 7b514c04a13742b1b19d46fec1c40f69 Sep 05 12:42:11.258765 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-AttachVolumeTestJSON-972329296 Sep 05 12:42:11.258765 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-AttachVolumeTestJSON-972329296-project Sep 05 12:42:11.258765 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:42:11.258765 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:42:11.258765 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: 8bfb013575d540c59121ac8a1613fc0f Sep 05 12:42:11.258765 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-AttachVolumeTestJSON-972329296-project Sep 05 12:42:11.258765 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: > Sep 05 12:42:11.258765 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 could not be found. Sep 05 12:42:11.258765 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': '74b8a4c9-d32d-4ae8-8c35-2093b6254310'} Sep 05 12:42:11.259674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:42:11.259674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:11.259674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:42:11.259674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:42:11.259674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:42:11.259674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:42:11.259674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:42:11.259674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:42:11.259674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:42:11.259674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:42:11.259674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 could not be found. Sep 05 12:42:11.259674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:11.259674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:11.259674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:11.259674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:11.259674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:11.259674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:11.259674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:42:11.259674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:42:11.259674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:42:11.261254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:42:11.261254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 12:42:11.261254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 12:42:11.261254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 12:42:11.261254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 12:42:11.261254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:42:11.261254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:42:11.261254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:42:11.261254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:42:11.261254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 could not be found. Sep 05 12:42:11.261254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:11.261254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:11.261254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:11.261254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:11.261254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:11.261254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:11.261254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:42:11.261254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:42:11.261254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 could not be found. Sep 05 12:42:11.261254 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:11.262894 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-fee5037e-76bc-4405-b7e3-d2e9d8a073d9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Returning 404 to user: Instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:42:11.262894 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-fee5037e-76bc-4405-b7e3-d2e9d8a073d9 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "DELETE /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 404 len: 111 microversion: 2.1 time: 0.029929 Sep 05 12:42:11.262894 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 591/1164] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:42:11 2022] DELETE /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:42:11.267418 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7570ad23-dd36-4b30-99bc-2e425427592c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:11.268059 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-7570ad23-dd36-4b30-99bc-2e425427592c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: 74b8a4c9-d32d-4ae8-8c35-2093b6254310] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:11.275029 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7570ad23-dd36-4b30-99bc-2e425427592c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:11.275510 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7570ad23-dd36-4b30-99bc-2e425427592c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:11.275966 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7570ad23-dd36-4b30-99bc-2e425427592c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:11.276651 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7570ad23-dd36-4b30-99bc-2e425427592c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:11.277101 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7570ad23-dd36-4b30-99bc-2e425427592c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:11.277524 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7570ad23-dd36-4b30-99bc-2e425427592c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:11.291151 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-7570ad23-dd36-4b30-99bc-2e425427592c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] HTTP exception thrown: Instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 could not be found. Sep 05 12:42:11.292802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7570ad23-dd36-4b30-99bc-2e425427592c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Request method failure captured: Sep 05 12:42:11.292802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 HTTP/1.1 Sep 05 12:42:11.292802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:42:11.292802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:42:11.292802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:42:11.292802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:42:11.292802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:42:11.292802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:42:11.292802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:42:11.292802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:42:11.292802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFe1tu5Jocwz5yIpNgejJjZbGztBoqr5CiMAmR1A_BRIA-NNF_OfAiZoEP0zdiJlL46PHC0fPTzMJPF_OwKatz5VqEPBZgDDI-hRwtpcIgkjzlDx-XFcSPYV8JqkZs7BWflL0iqFPkYmieyeC3GekDBj9lR-DKKB2PHJlUvw7-7B-cHc Sep 05 12:42:11.292802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:42:11.292802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:42:11.292802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:42:11.292802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:42:11.292802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:42:11.292802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:42:11.292802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 7b514c04a13742b1b19d46fec1c40f69 Sep 05 12:42:11.292802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-AttachVolumeTestJSON-972329296 Sep 05 12:42:11.292802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:42:11.292802 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:42:11.294463 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:42:11.294463 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-AttachVolumeTestJSON-972329296 Sep 05 12:42:11.294463 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 7b514c04a13742b1b19d46fec1c40f69 Sep 05 12:42:11.294463 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-AttachVolumeTestJSON-972329296 Sep 05 12:42:11.294463 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-AttachVolumeTestJSON-972329296-project Sep 05 12:42:11.294463 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:42:11.294463 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:42:11.294463 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: 8bfb013575d540c59121ac8a1613fc0f Sep 05 12:42:11.294463 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-AttachVolumeTestJSON-972329296-project Sep 05 12:42:11.294463 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:42:11.294463 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 could not be found. Sep 05 12:42:11.294463 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': '74b8a4c9-d32d-4ae8-8c35-2093b6254310'} Sep 05 12:42:11.295672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:42:11.295672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:11.295672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:42:11.295672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:42:11.295672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:42:11.295672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:42:11.295672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:42:11.295672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:42:11.295672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:42:11.295672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:42:11.295672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 could not be found. Sep 05 12:42:11.295672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:11.295672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:11.295672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:11.295672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:11.295672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:11.295672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:11.295672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:42:11.295672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:42:11.295672 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:42:11.297334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:42:11.297334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:42:11.297334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:42:11.297334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:42:11.297334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:42:11.297334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:42:11.297334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:42:11.297334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 could not be found. Sep 05 12:42:11.297334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:11.297334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:11.297334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:11.297334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:11.297334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:11.297334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:11.297334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:42:11.297334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:42:11.297334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 could not be found. Sep 05 12:42:11.297334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:11.298700 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7570ad23-dd36-4b30-99bc-2e425427592c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Returning 404 to user: Instance 74b8a4c9-d32d-4ae8-8c35-2093b6254310 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:42:11.298700 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-7570ad23-dd36-4b30-99bc-2e425427592c tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310" status: 404 len: 111 microversion: 2.1 time: 0.031170 Sep 05 12:42:11.298700 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 574/1165] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:42:11 2022] GET /compute/v2.1/servers/74b8a4c9-d32d-4ae8-8c35-2093b6254310 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:42:12.533517 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-04bef801-a7a6-4aa1-b4df-210834834cea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:12.534013 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-04bef801-a7a6-4aa1-b4df-210834834cea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:12.540903 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-04bef801-a7a6-4aa1-b4df-210834834cea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:12.541382 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-04bef801-a7a6-4aa1-b4df-210834834cea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:12.541816 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-04bef801-a7a6-4aa1-b4df-210834834cea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:12.542500 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-04bef801-a7a6-4aa1-b4df-210834834cea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:12.542952 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-04bef801-a7a6-4aa1-b4df-210834834cea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:12.543390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-04bef801-a7a6-4aa1-b4df-210834834cea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:12.557092 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-04bef801-a7a6-4aa1-b4df-210834834cea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] HTTP exception thrown: Instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 could not be found. Sep 05 12:42:12.558619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-04bef801-a7a6-4aa1-b4df-210834834cea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Request method failure captured: Sep 05 12:42:12.558619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: DELETE /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 HTTP/1.1 Sep 05 12:42:12.558619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:42:12.558619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:42:12.558619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:42:12.558619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:42:12.558619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:42:12.558619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:42:12.558619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:42:12.558619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:42:12.558619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFe1tu5Jocwz5yIpNgejJjZbGztBoqr5CiMAmR1A_BRIA-NNF_OfAiZoEP0zdiJlL46PHC0fPTzMJPF_OwKatz5VqEPBZgDDI-hRwtpcIgkjzlDx-XFcSPYV8JqkZs7BWflL0iqFPkYmieyeC3GekDBj9lR-DKKB2PHJlUvw7-7B-cHc Sep 05 12:42:12.558619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:42:12.558619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:42:12.558619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:42:12.558619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:42:12.558619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:42:12.558619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:42:12.558619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 7b514c04a13742b1b19d46fec1c40f69 Sep 05 12:42:12.558619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-AttachVolumeTestJSON-972329296 Sep 05 12:42:12.558619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:42:12.558619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:42:12.560260 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:42:12.560260 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-AttachVolumeTestJSON-972329296 Sep 05 12:42:12.560260 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 7b514c04a13742b1b19d46fec1c40f69 Sep 05 12:42:12.560260 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-AttachVolumeTestJSON-972329296 Sep 05 12:42:12.560260 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-AttachVolumeTestJSON-972329296-project Sep 05 12:42:12.560260 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:42:12.560260 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:42:12.560260 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: 8bfb013575d540c59121ac8a1613fc0f Sep 05 12:42:12.560260 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-AttachVolumeTestJSON-972329296-project Sep 05 12:42:12.560260 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: > Sep 05 12:42:12.560260 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 could not be found. Sep 05 12:42:12.560260 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': 'd7a5d85b-7178-468f-8bc1-f4a6ccef9d14'} Sep 05 12:42:12.561091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:42:12.561091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:12.561091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:42:12.561091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:42:12.561091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:42:12.561091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:42:12.561091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:42:12.561091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:42:12.561091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:42:12.561091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:42:12.561091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 could not be found. Sep 05 12:42:12.561091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:12.561091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:12.561091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:12.561091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:12.561091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:12.561091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:12.561091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:42:12.561091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:42:12.561091 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:42:12.562345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:42:12.562345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 12:42:12.562345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 12:42:12.562345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 12:42:12.562345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 12:42:12.562345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:42:12.562345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:42:12.562345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:42:12.562345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:42:12.562345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 could not be found. Sep 05 12:42:12.562345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:12.562345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:12.562345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:12.562345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:12.562345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:12.562345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:12.562345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:42:12.562345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:42:12.562345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 could not be found. Sep 05 12:42:12.562345 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:12.563643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-04bef801-a7a6-4aa1-b4df-210834834cea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Returning 404 to user: Instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:42:12.563643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-04bef801-a7a6-4aa1-b4df-210834834cea tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 404 len: 111 microversion: 2.1 time: 0.030315 Sep 05 12:42:12.563643 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 592/1166] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:42:12 2022] DELETE /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:42:12.568553 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ffa17dd6-e913-41f6-9a9f-d3ac5d107f97 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:12.569193 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-ffa17dd6-e913-41f6-9a9f-d3ac5d107f97 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] [instance: d7a5d85b-7178-468f-8bc1-f4a6ccef9d14] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:42:12.575661 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ffa17dd6-e913-41f6-9a9f-d3ac5d107f97 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:12.576144 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ffa17dd6-e913-41f6-9a9f-d3ac5d107f97 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:12.576647 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ffa17dd6-e913-41f6-9a9f-d3ac5d107f97 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:12.577387 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ffa17dd6-e913-41f6-9a9f-d3ac5d107f97 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:42:12.577842 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ffa17dd6-e913-41f6-9a9f-d3ac5d107f97 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:42:12.578264 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-ffa17dd6-e913-41f6-9a9f-d3ac5d107f97 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:42:12.592113 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-ffa17dd6-e913-41f6-9a9f-d3ac5d107f97 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] HTTP exception thrown: Instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 could not be found. Sep 05 12:42:12.593719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ffa17dd6-e913-41f6-9a9f-d3ac5d107f97 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Request method failure captured: Sep 05 12:42:12.593719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 HTTP/1.1 Sep 05 12:42:12.593719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:42:12.593719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:42:12.593719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:42:12.593719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:42:12.593719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:42:12.593719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:42:12.593719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:42:12.593719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:42:12.593719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFe1tu5Jocwz5yIpNgejJjZbGztBoqr5CiMAmR1A_BRIA-NNF_OfAiZoEP0zdiJlL46PHC0fPTzMJPF_OwKatz5VqEPBZgDDI-hRwtpcIgkjzlDx-XFcSPYV8JqkZs7BWflL0iqFPkYmieyeC3GekDBj9lR-DKKB2PHJlUvw7-7B-cHc Sep 05 12:42:12.593719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:42:12.593719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:42:12.593719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:42:12.593719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:42:12.593719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:42:12.593719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:42:12.593719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 7b514c04a13742b1b19d46fec1c40f69 Sep 05 12:42:12.593719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-AttachVolumeTestJSON-972329296 Sep 05 12:42:12.593719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:42:12.593719 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:42:12.595326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7b514c04a13742b1b19d46fec1c40f69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:42:12.595326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-AttachVolumeTestJSON-972329296 Sep 05 12:42:12.595326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 7b514c04a13742b1b19d46fec1c40f69 Sep 05 12:42:12.595326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-AttachVolumeTestJSON-972329296 Sep 05 12:42:12.595326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-AttachVolumeTestJSON-972329296-project Sep 05 12:42:12.595326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:42:12.595326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:42:12.595326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: 8bfb013575d540c59121ac8a1613fc0f Sep 05 12:42:12.595326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-AttachVolumeTestJSON-972329296-project Sep 05 12:42:12.595326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:42:12.595326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 could not be found. Sep 05 12:42:12.595326 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': 'd7a5d85b-7178-468f-8bc1-f4a6ccef9d14'} Sep 05 12:42:12.596263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:42:12.596263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:12.596263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:42:12.596263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:42:12.596263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:42:12.596263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:42:12.596263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:42:12.596263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:42:12.596263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:42:12.596263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:42:12.596263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 could not be found. Sep 05 12:42:12.596263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:12.596263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:12.596263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:12.596263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:12.596263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:12.596263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:12.596263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:42:12.596263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:42:12.596263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:42:12.597853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:42:12.597853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:42:12.597853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:42:12.597853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:42:12.597853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:42:12.597853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:42:12.597853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:42:12.597853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 could not be found. Sep 05 12:42:12.597853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:12.597853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:12.597853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:12.597853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:12.597853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:12.597853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:12.597853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:42:12.597853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:42:12.597853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 could not be found. Sep 05 12:42:12.597853 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:12.599187 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-ffa17dd6-e913-41f6-9a9f-d3ac5d107f97 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] Returning 404 to user: Instance d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:42:12.599187 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-ffa17dd6-e913-41f6-9a9f-d3ac5d107f97 tempest-AttachVolumeTestJSON-972329296 tempest-AttachVolumeTestJSON-972329296-project] 10.222.0.62 "GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14" status: 404 len: 111 microversion: 2.1 time: 0.030496 Sep 05 12:42:12.599187 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 575/1167] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:42:12 2022] GET /compute/v2.1/servers/d7a5d85b-7178-468f-8bc1-f4a6ccef9d14 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:42:18.020308 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-5280a05d-92e8-4e86-b86a-7b1851ae99ac tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] Action: 'create', calling method: .version_select at 0x7fe712995ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-310795731", "metadata": {"Type": "work"}}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:42:18.039861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-5280a05d-92e8-4e86-b86a-7b1851ae99ac tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] Request method failure captured: Sep 05 12:42:18.039861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 05 12:42:18.039861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:42:18.039861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:42:18.039861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:42:18.039861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 121 Sep 05 12:42:18.039861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:42:18.039861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:42:18.039861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:42:18.039861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:42:18.039861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFe6pWiR5OP4WVFHBUncS9xCcVPHgF4H3d3KME5UQgGMK0MfRIQdTDeXB8Dx43X_hEeO0WyqCwou4rrD677ibwMUxJe_YF4EjEq-wRuQCPt_bqCgFwLxg1idgviiBvL3twHTBVikjfupDJmfcMy7yDxNykZLHYGwIP9UsM9SFs3lXpDc Sep 05 12:42:18.039861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:42:18.039861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:42:18.039861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:42:18.039861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:42:18.039861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:42:18.039861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:42:18.039861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 8bc09f98701c49d5a36a49e8001b5591 Sep 05 12:42:18.039861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-VolumesNegativeTest-1043829595 Sep 05 12:42:18.039861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:42:18.039861 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:42:18.041496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:42:18.041496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-VolumesNegativeTest-1043829595 Sep 05 12:42:18.041496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 8bc09f98701c49d5a36a49e8001b5591 Sep 05 12:42:18.041496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-VolumesNegativeTest-1043829595 Sep 05 12:42:18.041496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-VolumesNegativeTest-1043829595-project Sep 05 12:42:18.041496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:42:18.041496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:42:18.041496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: c772ccc9f9c14e41863827a4a5740077 Sep 05 12:42:18.041496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-VolumesNegativeTest-1043829595-project Sep 05 12:42:18.041496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Sep 05 12:42:18.041496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-310795731", "metadata": {"Type": "work"}}} Sep 05 12:42:18.041496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: Sep 05 12:42:18.041496 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-310795731', 'metadata': {'Type': 'work'}}}} Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise error Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi '#$%' Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:42:18.043010 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:42:18.045099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:42:18.045099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:42:18.045099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:42:18.045099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:42:18.045099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 05 12:42:18.045099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 05 12:42:18.045099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 05 12:42:18.045099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 05 12:42:18.045099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 05 12:42:18.045099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 05 12:42:18.045099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 05 12:42:18.045099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.045099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:18.045099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.045099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:18.045099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:18.045099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:18.045099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 05 12:42:18.045099 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 05 12:42:18.049986 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 05 12:42:18.049986 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.049986 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-5280a05d-92e8-4e86-b86a-7b1851ae99ac tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:42:18.049986 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-5280a05d-92e8-4e86-b86a-7b1851ae99ac tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.133428 Sep 05 12:42:18.049986 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 593/1168] 10.222.0.62 () {60 vars in 1156 bytes} [Mon Sep 5 12:42:17 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 12:42:18.052481 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4f08517c-7026-48dd-b9bb-aeffc4fa248e tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] Action: 'create', calling method: .version_select at 0x7fe7129e8940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1584018635", "metadata": {"Type": "work"}}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:42:18.057291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4f08517c-7026-48dd-b9bb-aeffc4fa248e tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] Request method failure captured: Sep 05 12:42:18.057291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 05 12:42:18.057291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:42:18.057291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:42:18.057291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:42:18.057291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 120 Sep 05 12:42:18.057291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:42:18.057291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:42:18.057291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:42:18.057291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:42:18.057291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFe6pWiR5OP4WVFHBUncS9xCcVPHgF4H3d3KME5UQgGMK0MfRIQdTDeXB8Dx43X_hEeO0WyqCwou4rrD677ibwMUxJe_YF4EjEq-wRuQCPt_bqCgFwLxg1idgviiBvL3twHTBVikjfupDJmfcMy7yDxNykZLHYGwIP9UsM9SFs3lXpDc Sep 05 12:42:18.057291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:42:18.057291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:42:18.057291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:42:18.057291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:42:18.057291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:42:18.057291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:42:18.057291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 8bc09f98701c49d5a36a49e8001b5591 Sep 05 12:42:18.057291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-VolumesNegativeTest-1043829595 Sep 05 12:42:18.057291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:42:18.057291 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:42:18.058898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:42:18.058898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-VolumesNegativeTest-1043829595 Sep 05 12:42:18.058898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 8bc09f98701c49d5a36a49e8001b5591 Sep 05 12:42:18.058898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-VolumesNegativeTest-1043829595 Sep 05 12:42:18.058898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-VolumesNegativeTest-1043829595-project Sep 05 12:42:18.058898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:42:18.058898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:42:18.058898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: c772ccc9f9c14e41863827a4a5740077 Sep 05 12:42:18.058898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-VolumesNegativeTest-1043829595-project Sep 05 12:42:18.058898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Sep 05 12:42:18.058898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1584018635", "metadata": {"Type": "work"}}} Sep 05 12:42:18.058898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: Sep 05 12:42:18.058898 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1584018635', 'metadata': {'Type': 'work'}}}} Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise error Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi '0' Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:42:18.063670 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:42:18.065060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:42:18.065060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:42:18.065060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:42:18.065060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:42:18.065060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 05 12:42:18.065060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 05 12:42:18.065060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 05 12:42:18.065060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 05 12:42:18.065060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 05 12:42:18.065060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 05 12:42:18.065060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 05 12:42:18.065060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.065060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:18.065060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.065060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:18.065060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:18.065060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:18.065060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 05 12:42:18.065060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 05 12:42:18.066245 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 05 12:42:18.066245 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.066245 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4f08517c-7026-48dd-b9bb-aeffc4fa248e tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:42:18.066245 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-4f08517c-7026-48dd-b9bb-aeffc4fa248e tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010641 Sep 05 12:42:18.066245 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 576/1169] 10.222.0.62 () {60 vars in 1156 bytes} [Mon Sep 5 12:42:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 05 12:42:18.068156 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c069ec61-632f-4b85-a53a-7062de7d4371 tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] Action: 'create', calling method: .version_select at 0x7fe712869ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-898176286", "metadata": {"Type": "work"}}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:42:18.072780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c069ec61-632f-4b85-a53a-7062de7d4371 tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] Request method failure captured: Sep 05 12:42:18.072780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 05 12:42:18.072780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:42:18.072780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:42:18.072780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:42:18.072780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 118 Sep 05 12:42:18.072780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:42:18.072780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:42:18.072780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:42:18.072780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:42:18.072780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFe6pWiR5OP4WVFHBUncS9xCcVPHgF4H3d3KME5UQgGMK0MfRIQdTDeXB8Dx43X_hEeO0WyqCwou4rrD677ibwMUxJe_YF4EjEq-wRuQCPt_bqCgFwLxg1idgviiBvL3twHTBVikjfupDJmfcMy7yDxNykZLHYGwIP9UsM9SFs3lXpDc Sep 05 12:42:18.072780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:42:18.072780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:42:18.072780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:42:18.072780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:42:18.072780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:42:18.072780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:42:18.072780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 8bc09f98701c49d5a36a49e8001b5591 Sep 05 12:42:18.072780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-VolumesNegativeTest-1043829595 Sep 05 12:42:18.072780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:42:18.072780 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:42:18.074507 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:42:18.074507 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-VolumesNegativeTest-1043829595 Sep 05 12:42:18.074507 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 8bc09f98701c49d5a36a49e8001b5591 Sep 05 12:42:18.074507 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-VolumesNegativeTest-1043829595 Sep 05 12:42:18.074507 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-VolumesNegativeTest-1043829595-project Sep 05 12:42:18.074507 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:42:18.074507 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:42:18.074507 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: c772ccc9f9c14e41863827a4a5740077 Sep 05 12:42:18.074507 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-VolumesNegativeTest-1043829595-project Sep 05 12:42:18.074507 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Sep 05 12:42:18.074507 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-898176286", "metadata": {"Type": "work"}}} Sep 05 12:42:18.074507 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: Sep 05 12:42:18.074507 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-898176286', 'metadata': {'Type': 'work'}}}} Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise error Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi '' Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:42:18.075454 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:42:18.079779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:42:18.079779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:42:18.079779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:42:18.079779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:42:18.079779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 05 12:42:18.079779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 05 12:42:18.079779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 05 12:42:18.079779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 05 12:42:18.079779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 05 12:42:18.079779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 05 12:42:18.079779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 05 12:42:18.079779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.079779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:18.079779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.079779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:18.079779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:18.079779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:18.079779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 05 12:42:18.079779 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 05 12:42:18.081359 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 05 12:42:18.081359 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.081359 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c069ec61-632f-4b85-a53a-7062de7d4371 tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:42:18.081359 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-c069ec61-632f-4b85-a53a-7062de7d4371 tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010032 Sep 05 12:42:18.081359 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 594/1170] 10.222.0.62 () {60 vars in 1156 bytes} [Mon Sep 5 12:42:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 12:42:18.087563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e0f2681a-b203-4004-95c5-d3706128318d tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] Calling method '.version_select at 0x7fe7128d19d0>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:18.119077 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-e0f2681a-b203-4004-95c5-d3706128318d tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] HTTP exception thrown: Volume tempest-invalid-1420827768 could not be found. Sep 05 12:42:18.121069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e0f2681a-b203-4004-95c5-d3706128318d tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] Request method failure captured: Sep 05 12:42:18.121069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1420827768 HTTP/1.1 Sep 05 12:42:18.121069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:42:18.121069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:42:18.121069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:42:18.121069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:42:18.121069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:42:18.121069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:42:18.121069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:42:18.121069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:42:18.121069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFe6pWiR5OP4WVFHBUncS9xCcVPHgF4H3d3KME5UQgGMK0MfRIQdTDeXB8Dx43X_hEeO0WyqCwou4rrD677ibwMUxJe_YF4EjEq-wRuQCPt_bqCgFwLxg1idgviiBvL3twHTBVikjfupDJmfcMy7yDxNykZLHYGwIP9UsM9SFs3lXpDc Sep 05 12:42:18.121069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:42:18.121069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:42:18.121069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:42:18.121069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:42:18.121069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:42:18.121069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:42:18.121069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 8bc09f98701c49d5a36a49e8001b5591 Sep 05 12:42:18.121069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-VolumesNegativeTest-1043829595 Sep 05 12:42:18.121069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:42:18.121069 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:42:18.122687 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:42:18.122687 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-VolumesNegativeTest-1043829595 Sep 05 12:42:18.122687 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 8bc09f98701c49d5a36a49e8001b5591 Sep 05 12:42:18.122687 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-VolumesNegativeTest-1043829595 Sep 05 12:42:18.122687 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-VolumesNegativeTest-1043829595-project Sep 05 12:42:18.122687 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:42:18.122687 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:42:18.122687 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: c772ccc9f9c14e41863827a4a5740077 Sep 05 12:42:18.122687 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-VolumesNegativeTest-1043829595-project Sep 05 12:42:18.122687 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: Sep 05 12:42:18.122687 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Volume tempest-invalid-1420827768 could not be found. Sep 05 12:42:18.122687 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': 'tempest-invalid-1420827768'} Sep 05 12:42:18.122687 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:42:18.123723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:18.123723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:42:18.123723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:42:18.123723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 12:42:18.123723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 12:42:18.123723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 12:42:18.123723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 12:42:18.123723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 12:42:18.123723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 12:42:18.123723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 12:42:18.123723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 12:42:18.123723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:42:18.123723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:42:18.123723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:42:18.123723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:42:18.123723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1420827768 could not be found. (HTTP 404) (Request-ID: req-5427a5a2-af13-4484-b314-c64f5477cd72) Sep 05 12:42:18.123723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.123723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:18.123723 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.125330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:18.125330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 05 12:42:18.125330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 05 12:42:18.125330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 12:42:18.125330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 12:42:18.125330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 12:42:18.125330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 12:42:18.125330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 12:42:18.125330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 12:42:18.125330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:42:18.125330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:42:18.125330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 12:42:18.125330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 12:42:18.125330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 12:42:18.125330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 12:42:18.125330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 12:42:18.125330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 12:42:18.125330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 12:42:18.125330 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 12:42:18.127257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:42:18.127257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:42:18.127257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:42:18.127257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:42:18.127257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1420827768 could not be found. Sep 05 12:42:18.127257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.127257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:18.127257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.127257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:18.127257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:18.127257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:18.127257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:42:18.127257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:42:18.127257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:42:18.127257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:42:18.127257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:42:18.127257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:42:18.127257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 05 12:42:18.127257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:42:18.127257 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1420827768 could not be found. Sep 05 12:42:18.129068 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.129068 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:18.129068 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.129068 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:18.129068 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:18.129068 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:18.129068 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:42:18.129068 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:42:18.129068 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1420827768 could not be found. Sep 05 12:42:18.129068 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.129068 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-e0f2681a-b203-4004-95c5-d3706128318d tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] Returning 404 to user: Volume tempest-invalid-1420827768 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:42:18.129068 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-e0f2681a-b203-4004-95c5-d3706128318d tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1420827768" status: 404 len: 99 microversion: 2.1 time: 0.039862 Sep 05 12:42:18.129068 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 577/1171] 10.222.0.62 () {58 vars in 1218 bytes} [Mon Sep 5 12:42:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1420827768 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 05 12:42:18.132640 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ad310b58-9fc5-4ce5-9603-73472c8e8061 tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004202 Sep 05 12:42:18.133159 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 595/1172] 10.222.0.62 () {58 vars in 1140 bytes} [Mon Sep 5 12:42:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 05 12:42:18.141832 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-f32eb788-75cf-4145-82ca-5363b55e6495 tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004037 Sep 05 12:42:18.142309 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 578/1173] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Sep 5 12:42:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 05 12:42:18.151397 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1ae81538-5624-45c1-84d2-c482b8b56d99 tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] Calling method '.version_select at 0x7fe7129950d0>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:18.179623 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.wsgi [None req-1ae81538-5624-45c1-84d2-c482b8b56d99 tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] HTTP exception thrown: Volume 8efb8daf-e8da-415a-b9f6-e47a3df1407b could not be found. Sep 05 12:42:18.181611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1ae81538-5624-45c1-84d2-c482b8b56d99 tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] Request method failure captured: Sep 05 12:42:18.181611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: request: DELETE /compute/v2.1/os-volumes/8efb8daf-e8da-415a-b9f6-e47a3df1407b HTTP/1.1 Sep 05 12:42:18.181611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept: application/json Sep 05 12:42:18.181611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Accept-Encoding: identity Sep 05 12:42:18.181611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Connection: close Sep 05 12:42:18.181611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Length: 0 Sep 05 12:42:18.181611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Content-Type: application/json Sep 05 12:42:18.181611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Host: 10.222.0.62 Sep 05 12:42:18.181611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Openstack-System-Scope: None Sep 05 12:42:18.181611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: User-Agent: python-urllib3/1.26.12 Sep 05 12:42:18.181611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Auth-Token: gAAAAABjFe6pWiR5OP4WVFHBUncS9xCcVPHgF4H3d3KME5UQgGMK0MfRIQdTDeXB8Dx43X_hEeO0WyqCwou4rrD677ibwMUxJe_YF4EjEq-wRuQCPt_bqCgFwLxg1idgviiBvL3twHTBVikjfupDJmfcMy7yDxNykZLHYGwIP9UsM9SFs3lXpDc Sep 05 12:42:18.181611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Id: None Sep 05 12:42:18.181611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Domain-Name: None Sep 05 12:42:18.181611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Identity-Status: Confirmed Sep 05 12:42:18.181611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Is-Admin-Project: True Sep 05 12:42:18.181611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Id: default Sep 05 12:42:18.181611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Domain-Name: Default Sep 05 12:42:18.181611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Id: 8bc09f98701c49d5a36a49e8001b5591 Sep 05 12:42:18.181611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Project-Name: tempest-VolumesNegativeTest-1043829595 Sep 05 12:42:18.181611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Role: member,reader Sep 05 12:42:18.181611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Roles: member,reader Sep 05 12:42:18.183328 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:42:18.183328 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant: tempest-VolumesNegativeTest-1043829595 Sep 05 12:42:18.183328 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Id: 8bc09f98701c49d5a36a49e8001b5591 Sep 05 12:42:18.183328 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-Tenant-Name: tempest-VolumesNegativeTest-1043829595 Sep 05 12:42:18.183328 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User: tempest-VolumesNegativeTest-1043829595-project Sep 05 12:42:18.183328 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Id: default Sep 05 12:42:18.183328 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Domain-Name: Default Sep 05 12:42:18.183328 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Id: c772ccc9f9c14e41863827a4a5740077 Sep 05 12:42:18.183328 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: X-User-Name: tempest-VolumesNegativeTest-1043829595-project Sep 05 12:42:18.183328 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: method: Sep 05 12:42:18.183328 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: exception: Volume 8efb8daf-e8da-415a-b9f6-e47a3df1407b could not be found. Sep 05 12:42:18.183328 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: action_args: {'id': '8efb8daf-e8da-415a-b9f6-e47a3df1407b'} Sep 05 12:42:18.183328 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:42:18.184274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:18.184274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:42:18.184274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:42:18.184274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 12:42:18.184274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 12:42:18.184274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 12:42:18.184274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 12:42:18.184274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 12:42:18.184274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 12:42:18.184274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 12:42:18.184274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 12:42:18.184274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:42:18.184274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:42:18.184274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:42:18.184274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:42:18.184274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8efb8daf-e8da-415a-b9f6-e47a3df1407b could not be found. (HTTP 404) (Request-ID: req-6e2267cf-284a-4dda-94c6-18e97664304d) Sep 05 12:42:18.184274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.184274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:18.184274 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.185703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:18.185703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 05 12:42:18.185703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 05 12:42:18.185703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 12:42:18.185703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 12:42:18.185703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 12:42:18.185703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 12:42:18.185703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 12:42:18.185703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 12:42:18.185703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:42:18.185703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:42:18.185703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 12:42:18.185703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 12:42:18.185703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 12:42:18.185703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 12:42:18.185703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 12:42:18.185703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 12:42:18.185703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 12:42:18.185703 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 12:42:18.187651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:42:18.187651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:42:18.187651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:42:18.187651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:42:18.187651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8efb8daf-e8da-415a-b9f6-e47a3df1407b could not be found. Sep 05 12:42:18.187651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.187651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:18.187651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.187651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:18.187651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:18.187651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:18.187651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:42:18.187651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:42:18.187651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:42:18.187651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:42:18.187651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:42:18.187651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:42:18.187651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 05 12:42:18.187651 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:42:18.189088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8efb8daf-e8da-415a-b9f6-e47a3df1407b could not be found. Sep 05 12:42:18.189088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.189088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:18.189088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.189088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:18.189088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:18.189088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:18.189088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:42:18.189088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:42:18.189088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8efb8daf-e8da-415a-b9f6-e47a3df1407b could not be found. Sep 05 12:42:18.189088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.189088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1ae81538-5624-45c1-84d2-c482b8b56d99 tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] Returning 404 to user: Volume 8efb8daf-e8da-415a-b9f6-e47a3df1407b could not be found. {{(pid=121211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:42:18.189088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1ae81538-5624-45c1-84d2-c482b8b56d99 tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/8efb8daf-e8da-415a-b9f6-e47a3df1407b" status: 404 len: 109 microversion: 2.1 time: 0.035951 Sep 05 12:42:18.189088 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 596/1174] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Sep 5 12:42:18 2022] DELETE /compute/v2.1/os-volumes/8efb8daf-e8da-415a-b9f6-e47a3df1407b => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:42:18.192844 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-977f89e8-2cc2-4c18-8056-2852d3151470 tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] Calling method '.version_select at 0x7fe712d3a670>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:42:18.220571 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-977f89e8-2cc2-4c18-8056-2852d3151470 tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] HTTP exception thrown: Volume 5f036b7e-a4da-4d00-ae52-ee797abeb725 could not be found. Sep 05 12:42:18.222491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-977f89e8-2cc2-4c18-8056-2852d3151470 tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] Request method failure captured: Sep 05 12:42:18.222491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/os-volumes/5f036b7e-a4da-4d00-ae52-ee797abeb725 HTTP/1.1 Sep 05 12:42:18.222491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:42:18.222491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:42:18.222491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:42:18.222491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:42:18.222491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:42:18.222491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:42:18.222491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:42:18.222491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:42:18.222491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFe6pWiR5OP4WVFHBUncS9xCcVPHgF4H3d3KME5UQgGMK0MfRIQdTDeXB8Dx43X_hEeO0WyqCwou4rrD677ibwMUxJe_YF4EjEq-wRuQCPt_bqCgFwLxg1idgviiBvL3twHTBVikjfupDJmfcMy7yDxNykZLHYGwIP9UsM9SFs3lXpDc Sep 05 12:42:18.222491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:42:18.222491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:42:18.222491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:42:18.222491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:42:18.222491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:42:18.222491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:42:18.222491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 8bc09f98701c49d5a36a49e8001b5591 Sep 05 12:42:18.222491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-VolumesNegativeTest-1043829595 Sep 05 12:42:18.222491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:42:18.222491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:42:18.224195 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8bc09f98701c49d5a36a49e8001b5591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:42:18.224195 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-VolumesNegativeTest-1043829595 Sep 05 12:42:18.224195 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 8bc09f98701c49d5a36a49e8001b5591 Sep 05 12:42:18.224195 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-VolumesNegativeTest-1043829595 Sep 05 12:42:18.224195 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-VolumesNegativeTest-1043829595-project Sep 05 12:42:18.224195 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:42:18.224195 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:42:18.224195 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: c772ccc9f9c14e41863827a4a5740077 Sep 05 12:42:18.224195 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-VolumesNegativeTest-1043829595-project Sep 05 12:42:18.224195 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: Sep 05 12:42:18.224195 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Volume 5f036b7e-a4da-4d00-ae52-ee797abeb725 could not be found. Sep 05 12:42:18.224195 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': '5f036b7e-a4da-4d00-ae52-ee797abeb725'} Sep 05 12:42:18.224195 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:42:18.225262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:18.225262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:42:18.225262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:42:18.225262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 12:42:18.225262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 12:42:18.225262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 12:42:18.225262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 12:42:18.225262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 12:42:18.225262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 12:42:18.225262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 12:42:18.225262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 12:42:18.225262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:42:18.225262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:42:18.225262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:42:18.225262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:42:18.225262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f036b7e-a4da-4d00-ae52-ee797abeb725 could not be found. (HTTP 404) (Request-ID: req-def7076d-788e-40aa-836e-01b584136e1f) Sep 05 12:42:18.225262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.225262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:18.225262 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.227375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:18.227375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 05 12:42:18.227375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 05 12:42:18.227375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 12:42:18.227375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 12:42:18.227375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 12:42:18.227375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 12:42:18.227375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 12:42:18.227375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 12:42:18.227375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 12:42:18.227375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 12:42:18.227375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 12:42:18.227375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 12:42:18.227375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 12:42:18.227375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 12:42:18.227375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 12:42:18.227375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 12:42:18.227375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 12:42:18.227375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 12:42:18.229007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 12:42:18.229007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 12:42:18.229007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 12:42:18.229007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 12:42:18.229007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f036b7e-a4da-4d00-ae52-ee797abeb725 could not be found. Sep 05 12:42:18.229007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.229007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:18.229007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.229007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:18.229007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:18.229007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:18.229007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:42:18.229007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:42:18.229007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 12:42:18.229007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 12:42:18.229007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:42:18.229007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:42:18.229007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 05 12:42:18.229007 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:42:18.230521 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f036b7e-a4da-4d00-ae52-ee797abeb725 could not be found. Sep 05 12:42:18.230521 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.230521 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:42:18.230521 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.230521 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:42:18.230521 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:42:18.230521 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:42:18.230521 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:42:18.230521 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:42:18.230521 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f036b7e-a4da-4d00-ae52-ee797abeb725 could not be found. Sep 05 12:42:18.230521 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:42:18.230521 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-977f89e8-2cc2-4c18-8056-2852d3151470 tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] Returning 404 to user: Volume 5f036b7e-a4da-4d00-ae52-ee797abeb725 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:42:18.230521 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-977f89e8-2cc2-4c18-8056-2852d3151470 tempest-VolumesNegativeTest-1043829595 tempest-VolumesNegativeTest-1043829595-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/5f036b7e-a4da-4d00-ae52-ee797abeb725" status: 404 len: 109 microversion: 2.1 time: 0.035128 Sep 05 12:42:18.230521 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 579/1175] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Sep 5 12:42:18 2022] GET /compute/v2.1/os-volumes/5f036b7e-a4da-4d00-ae52-ee797abeb725 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:43:48.411492 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72ca1c46-c623-4f0c-9dfd-0416df20c79a] AMQP server on 10.222.0.62:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 05 12:43:48.411492 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=7 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:43:48.417268 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:43:48.417268 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 12:43:48.417268 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Mon Sep 5 12:43:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.62) !!! Sep 05 12:43:48.583283 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-baa9ddb8-48ce-48e8-ab2e-2e826310ec8f tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Action: 'create', calling method: .version_select at 0x7fe712b47a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1935271163", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEaFShzbb2rpjCP4NfSPX+DgMR2ZxpTUPH8+7YKzK0cBN3d0KP2mpWK7D5hyfBAfZVZo+VaAGv8hmtSkpdFygy8uwRDmWcDw+/ar3RB4OVqe59ZEQEu5C3dNaQdomlu9A=="}} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:43:48.599524 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-baa9ddb8-48ce-48e8-ab2e-2e826310ec8f tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Getting quotas for project 58a867fbd2d444728391be6de51146c9. Resources: {'key_pairs'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:43:48.605696 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.quota [None req-baa9ddb8-48ce-48e8-ab2e-2e826310ec8f tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Getting quotas for user e4315027930746c2b037efa139531914 and project 58a867fbd2d444728391be6de51146c9. Resources: {'key_pairs'} {{(pid=121211) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:43:48.697759 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-baa9ddb8-48ce-48e8-ab2e-2e826310ec8f tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.288743 Sep 05 12:43:48.698291 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 597/1176] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Sep 5 12:43:48 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:44:09.941084 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:44:09.941826 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:44:09.942709 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 12:44:09.942839 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Mon Sep 5 12:44:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.62) !!! Sep 05 12:44:09.945477 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 05 12:44:09.945616 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Mon Sep 5 12:44:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.62) !!! Sep 05 12:44:09.950762 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7553eb30-2b34-4030-88ea-f069c057facb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1759846097", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1935271163", "security_groups": [{"name": "tempest-secgroup-smoke-1641293063"}], "networks": [{"uuid": "9ecefe7b-b683-42a2-a063-26da0ebe8baf"}], "block_device_mapping_v2": [{"uuid": "216bde7d-702c-4861-8ef7-1a71ffa61940", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:44:10.067058 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.network.neutron [None req-7553eb30-2b34-4030-88ea-f069c057facb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] validate_networks() for [('9ecefe7b-b683-42a2-a063-26da0ebe8baf', None, None, None, None, None)] {{(pid=121210) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 12:44:10.526494 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-7553eb30-2b34-4030-88ea-f069c057facb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Flavor limits 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 12:44:10.526914 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-7553eb30-2b34-4030-88ea-f069c057facb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Image limits 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 12:44:10.527378 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-7553eb30-2b34-4030-88ea-f069c057facb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Flavor pref 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 12:44:10.527826 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-7553eb30-2b34-4030-88ea-f069c057facb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Image pref 0:0:0 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 12:44:10.528230 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.virt.hardware [None req-7553eb30-2b34-4030-88ea-f069c057facb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 12:44:10.537412 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7553eb30-2b34-4030-88ea-f069c057facb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:10.537883 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7553eb30-2b34-4030-88ea-f069c057facb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:10.538299 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7553eb30-2b34-4030-88ea-f069c057facb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:10.539011 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7553eb30-2b34-4030-88ea-f069c057facb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:10.539454 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7553eb30-2b34-4030-88ea-f069c057facb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:10.539890 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7553eb30-2b34-4030-88ea-f069c057facb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:10.556573 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-7553eb30-2b34-4030-88ea-f069c057facb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Getting quotas for project 58a867fbd2d444728391be6de51146c9. Resources: {'ram', 'instances', 'cores'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 12:44:10.560453 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.quota [None req-7553eb30-2b34-4030-88ea-f069c057facb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Getting quotas for user e4315027930746c2b037efa139531914 and project 58a867fbd2d444728391be6de51146c9. Resources: {'ram', 'instances', 'cores'} {{(pid=121210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 12:44:10.615646 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-7553eb30-2b34-4030-88ea-f069c057facb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Going to run 1 instances... {{(pid=121210) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 12:44:10.618293 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-7553eb30-2b34-4030-88ea-f069c057facb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='216bde7d-702c-4861-8ef7-1a71ffa61940',volume_size=None,volume_type=None)] {{(pid=121210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 12:44:10.989657 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-7553eb30-2b34-4030-88ea-f069c057facb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.050305 Sep 05 12:44:10.990606 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 580/1177] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Sep 5 12:44:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 12:44:11.002213 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-9821ebe7-0ee0-4743-b9a2-f266acb64de4 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:44:11.005275 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-9821ebe7-0ee0-4743-b9a2-f266acb64de4 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:44:11.008127 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=4 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:44:11.009025 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:44:11.033038 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO oslo.messaging._drivers.impl_rabbit [-] [72ca1c46-c623-4f0c-9dfd-0416df20c79a] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 45952. Sep 05 12:44:11.067225 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-9821ebe7-0ee0-4743-b9a2-f266acb64de4 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:44:11.075199 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-9821ebe7-0ee0-4743-b9a2-f266acb64de4 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1089 microversion: 2.1 time: 0.077142 Sep 05 12:44:11.075806 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 598/1178] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:44:10 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1089 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:44:12.098332 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-83384d66-3eb3-466a-9044-3b15bad45100 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:44:12.098937 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-83384d66-3eb3-466a-9044-3b15bad45100 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:44:12.105773 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-83384d66-3eb3-466a-9044-3b15bad45100 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:12.106245 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-83384d66-3eb3-466a-9044-3b15bad45100 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:12.106671 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-83384d66-3eb3-466a-9044-3b15bad45100 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:12.107349 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-83384d66-3eb3-466a-9044-3b15bad45100 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:12.107827 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-83384d66-3eb3-466a-9044-3b15bad45100 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:12.108243 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-83384d66-3eb3-466a-9044-3b15bad45100 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:12.170505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-83384d66-3eb3-466a-9044-3b15bad45100 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:44:12.178197 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-83384d66-3eb3-466a-9044-3b15bad45100 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1139 microversion: 2.1 time: 0.084098 Sep 05 12:44:12.178747 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 581/1179] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:44:12 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:44:13.202287 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f0ce3188-b045-40a5-afa8-9bf05833cd25 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:44:13.203061 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f0ce3188-b045-40a5-afa8-9bf05833cd25 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:44:13.211155 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f0ce3188-b045-40a5-afa8-9bf05833cd25 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:13.212211 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f0ce3188-b045-40a5-afa8-9bf05833cd25 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:13.212640 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f0ce3188-b045-40a5-afa8-9bf05833cd25 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:13.213325 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f0ce3188-b045-40a5-afa8-9bf05833cd25 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:13.213774 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f0ce3188-b045-40a5-afa8-9bf05833cd25 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:13.214194 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f0ce3188-b045-40a5-afa8-9bf05833cd25 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:13.576144 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f0ce3188-b045-40a5-afa8-9bf05833cd25 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:44:13.583619 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f0ce3188-b045-40a5-afa8-9bf05833cd25 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1195 microversion: 2.1 time: 0.385676 Sep 05 12:44:13.584179 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 599/1180] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:44:13 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1195 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:44:14.606365 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7b233591-c233-4e75-8ad5-bca6f05c970a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:44:14.606979 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-7b233591-c233-4e75-8ad5-bca6f05c970a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:44:14.613041 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7b233591-c233-4e75-8ad5-bca6f05c970a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:14.613752 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7b233591-c233-4e75-8ad5-bca6f05c970a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:14.614187 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7b233591-c233-4e75-8ad5-bca6f05c970a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:14.614894 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7b233591-c233-4e75-8ad5-bca6f05c970a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:14.615355 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7b233591-c233-4e75-8ad5-bca6f05c970a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:14.615803 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7b233591-c233-4e75-8ad5-bca6f05c970a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:14.748859 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-7b233591-c233-4e75-8ad5-bca6f05c970a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:44:14.757215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-7b233591-c233-4e75-8ad5-bca6f05c970a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1273 microversion: 2.1 time: 0.154845 Sep 05 12:44:14.757789 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 582/1181] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:44:14 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:44:15.266622 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-20492ef1-b5b2-4d83-a98a-d46fe893141d req-37fbcd31-a000-4c75-8a63-cd0ab6713db1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acfe1a7b-9132-4df1-b530-f0d30f94f388", "tag": "660352b3-2051-4619-91f9-5d36ed125af6"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:44:15.276850 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-20492ef1-b5b2-4d83-a98a-d46fe893141d req-37fbcd31-a000-4c75-8a63-cd0ab6713db1 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:15.277361 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-20492ef1-b5b2-4d83-a98a-d46fe893141d req-37fbcd31-a000-4c75-8a63-cd0ab6713db1 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:15.277797 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-20492ef1-b5b2-4d83-a98a-d46fe893141d req-37fbcd31-a000-4c75-8a63-cd0ab6713db1 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:15.288737 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-20492ef1-b5b2-4d83-a98a-d46fe893141d req-37fbcd31-a000-4c75-8a63-cd0ab6713db1 service nova] Creating event network-changed:660352b3-2051-4619-91f9-5d36ed125af6 for instance acfe1a7b-9132-4df1-b530-f0d30f94f388 on hv-cinder-80135 Sep 05 12:44:15.294439 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-20492ef1-b5b2-4d83-a98a-d46fe893141d req-37fbcd31-a000-4c75-8a63-cd0ab6713db1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031769 Sep 05 12:44:15.295032 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 600/1182] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:44:15.781206 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-60755b80-4d65-477c-a37a-6b7f80be0853 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:44:15.781830 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-60755b80-4d65-477c-a37a-6b7f80be0853 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:44:15.788493 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-60755b80-4d65-477c-a37a-6b7f80be0853 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:15.788980 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-60755b80-4d65-477c-a37a-6b7f80be0853 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:15.790050 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-60755b80-4d65-477c-a37a-6b7f80be0853 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:15.790753 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-60755b80-4d65-477c-a37a-6b7f80be0853 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:15.791224 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-60755b80-4d65-477c-a37a-6b7f80be0853 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:15.791691 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-60755b80-4d65-477c-a37a-6b7f80be0853 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:15.925443 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-60755b80-4d65-477c-a37a-6b7f80be0853 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:44:15.933129 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-60755b80-4d65-477c-a37a-6b7f80be0853 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1261 microversion: 2.1 time: 0.155816 Sep 05 12:44:15.933696 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 583/1183] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:44:15 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:44:16.956590 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-c05424c7-27eb-4cf1-9fbd-da9ff17d7b05 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:44:16.957283 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-c05424c7-27eb-4cf1-9fbd-da9ff17d7b05 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:44:16.963456 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c05424c7-27eb-4cf1-9fbd-da9ff17d7b05 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:16.963954 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c05424c7-27eb-4cf1-9fbd-da9ff17d7b05 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:16.964381 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c05424c7-27eb-4cf1-9fbd-da9ff17d7b05 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:16.965059 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c05424c7-27eb-4cf1-9fbd-da9ff17d7b05 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:16.965508 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c05424c7-27eb-4cf1-9fbd-da9ff17d7b05 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:16.965925 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-c05424c7-27eb-4cf1-9fbd-da9ff17d7b05 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:17.151862 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-c05424c7-27eb-4cf1-9fbd-da9ff17d7b05 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:44:17.159598 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-c05424c7-27eb-4cf1-9fbd-da9ff17d7b05 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1261 microversion: 2.1 time: 0.207751 Sep 05 12:44:17.160169 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 601/1184] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:44:16 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1261 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:44:18.182788 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-3b94beb4-f810-40ea-a52f-f808d4d19ed0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:44:18.183394 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-3b94beb4-f810-40ea-a52f-f808d4d19ed0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:44:18.189818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3b94beb4-f810-40ea-a52f-f808d4d19ed0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:18.190241 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3b94beb4-f810-40ea-a52f-f808d4d19ed0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:18.190671 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3b94beb4-f810-40ea-a52f-f808d4d19ed0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:18.191354 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3b94beb4-f810-40ea-a52f-f808d4d19ed0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:18.191843 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3b94beb4-f810-40ea-a52f-f808d4d19ed0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:18.192266 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-3b94beb4-f810-40ea-a52f-f808d4d19ed0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:18.368980 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-3b94beb4-f810-40ea-a52f-f808d4d19ed0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:44:18.376925 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-3b94beb4-f810-40ea-a52f-f808d4d19ed0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1261 microversion: 2.1 time: 0.198556 Sep 05 12:44:18.377491 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 584/1185] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:44:18 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1261 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:44:19.400052 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-218ae8b7-54a4-49b7-b2d7-01b231f908d0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:44:19.400579 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-218ae8b7-54a4-49b7-b2d7-01b231f908d0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:44:19.406934 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-218ae8b7-54a4-49b7-b2d7-01b231f908d0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:19.407413 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-218ae8b7-54a4-49b7-b2d7-01b231f908d0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:19.407879 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-218ae8b7-54a4-49b7-b2d7-01b231f908d0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:19.408569 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-218ae8b7-54a4-49b7-b2d7-01b231f908d0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:19.409030 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-218ae8b7-54a4-49b7-b2d7-01b231f908d0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:19.409456 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-218ae8b7-54a4-49b7-b2d7-01b231f908d0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:19.535206 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-218ae8b7-54a4-49b7-b2d7-01b231f908d0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:44:19.543416 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-218ae8b7-54a4-49b7-b2d7-01b231f908d0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1261 microversion: 2.1 time: 0.147847 Sep 05 12:44:19.544003 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 602/1186] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:44:19 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:44:20.566214 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-038b330b-b9a7-4903-abd4-9af0a0220f56 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:44:20.566790 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-038b330b-b9a7-4903-abd4-9af0a0220f56 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:44:20.569107 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=2 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:44:20.569789 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell0:SELECT=6 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:44:20.575047 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-038b330b-b9a7-4903-abd4-9af0a0220f56 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:20.575529 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-038b330b-b9a7-4903-abd4-9af0a0220f56 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:20.575987 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-038b330b-b9a7-4903-abd4-9af0a0220f56 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:20.576725 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-038b330b-b9a7-4903-abd4-9af0a0220f56 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:20.577178 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-038b330b-b9a7-4903-abd4-9af0a0220f56 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:20.577603 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-038b330b-b9a7-4903-abd4-9af0a0220f56 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:20.705322 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-038b330b-b9a7-4903-abd4-9af0a0220f56 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:44:20.713492 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-038b330b-b9a7-4903-abd4-9af0a0220f56 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1261 microversion: 2.1 time: 0.151283 Sep 05 12:44:20.714049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 585/1187] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:44:20 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:44:21.735870 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-8782337a-49e4-4dca-8cd8-845c50af8555 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:44:21.736485 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-8782337a-49e4-4dca-8cd8-845c50af8555 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:44:21.738910 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell0:SELECT=2 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:44:21.743699 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8782337a-49e4-4dca-8cd8-845c50af8555 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:21.744180 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8782337a-49e4-4dca-8cd8-845c50af8555 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:21.744614 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8782337a-49e4-4dca-8cd8-845c50af8555 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:21.745303 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8782337a-49e4-4dca-8cd8-845c50af8555 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:21.745756 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8782337a-49e4-4dca-8cd8-845c50af8555 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:21.746179 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-8782337a-49e4-4dca-8cd8-845c50af8555 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:21.926400 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-8782337a-49e4-4dca-8cd8-845c50af8555 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:44:21.930851 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-8782337a-49e4-4dca-8cd8-845c50af8555 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1261 microversion: 2.1 time: 0.198888 Sep 05 12:44:21.931455 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 603/1188] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:44:21 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1261 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:44:22.953726 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-176861f9-2dce-42b2-9763-760d07c50740 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:44:22.954279 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-176861f9-2dce-42b2-9763-760d07c50740 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:44:22.960665 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-176861f9-2dce-42b2-9763-760d07c50740 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:22.961142 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-176861f9-2dce-42b2-9763-760d07c50740 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:22.961575 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-176861f9-2dce-42b2-9763-760d07c50740 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:22.962258 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-176861f9-2dce-42b2-9763-760d07c50740 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:22.962708 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-176861f9-2dce-42b2-9763-760d07c50740 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:22.963128 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-176861f9-2dce-42b2-9763-760d07c50740 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:23.098615 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-176861f9-2dce-42b2-9763-760d07c50740 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:44:23.107266 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-176861f9-2dce-42b2-9763-760d07c50740 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1261 microversion: 2.1 time: 0.157444 Sep 05 12:44:23.107887 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 586/1189] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:44:22 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:44:24.130815 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-d90bd166-b215-4622-88ba-5b045674caaa tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:44:24.131436 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-d90bd166-b215-4622-88ba-5b045674caaa tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:44:24.138776 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d90bd166-b215-4622-88ba-5b045674caaa tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:24.139264 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d90bd166-b215-4622-88ba-5b045674caaa tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:24.139758 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d90bd166-b215-4622-88ba-5b045674caaa tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:24.140443 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d90bd166-b215-4622-88ba-5b045674caaa tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:24.140903 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d90bd166-b215-4622-88ba-5b045674caaa tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:24.141332 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-d90bd166-b215-4622-88ba-5b045674caaa tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:24.270540 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-d90bd166-b215-4622-88ba-5b045674caaa tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:44:24.278159 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-d90bd166-b215-4622-88ba-5b045674caaa tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1261 microversion: 2.1 time: 0.151205 Sep 05 12:44:24.278721 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 604/1190] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:44:24 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:44:25.301350 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4d7ea155-e9bf-48e4-92db-4c7eada81c10 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:44:25.301899 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-4d7ea155-e9bf-48e4-92db-4c7eada81c10 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:44:25.308241 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d7ea155-e9bf-48e4-92db-4c7eada81c10 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:25.308725 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d7ea155-e9bf-48e4-92db-4c7eada81c10 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:25.309157 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d7ea155-e9bf-48e4-92db-4c7eada81c10 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:25.309849 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d7ea155-e9bf-48e4-92db-4c7eada81c10 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:25.310301 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d7ea155-e9bf-48e4-92db-4c7eada81c10 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:25.310756 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4d7ea155-e9bf-48e4-92db-4c7eada81c10 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:25.441335 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-4d7ea155-e9bf-48e4-92db-4c7eada81c10 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:44:25.449560 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-4d7ea155-e9bf-48e4-92db-4c7eada81c10 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1261 microversion: 2.1 time: 0.152247 Sep 05 12:44:25.450141 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 587/1191] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:44:25 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:44:26.472589 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-49432991-2a93-4d17-b025-137b9024e6b4 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:44:26.473196 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-49432991-2a93-4d17-b025-137b9024e6b4 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:44:26.480149 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-49432991-2a93-4d17-b025-137b9024e6b4 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:26.480627 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-49432991-2a93-4d17-b025-137b9024e6b4 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:26.481057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-49432991-2a93-4d17-b025-137b9024e6b4 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:26.481740 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-49432991-2a93-4d17-b025-137b9024e6b4 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:26.482187 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-49432991-2a93-4d17-b025-137b9024e6b4 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:26.482611 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-49432991-2a93-4d17-b025-137b9024e6b4 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:26.609080 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-49432991-2a93-4d17-b025-137b9024e6b4 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:44:26.616721 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-49432991-2a93-4d17-b025-137b9024e6b4 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1261 microversion: 2.1 time: 0.148011 Sep 05 12:44:26.617285 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 605/1192] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:44:26 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:44:27.494845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-0836fd4d-bdc2-48a0-a633-bcddba87dc6b req-188c2976-41e7-4657-ad82-15a5670e7761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfe1a7b-9132-4df1-b530-f0d30f94f388", "name": "network-vif-plugged", "status": "completed", "tag": "660352b3-2051-4619-91f9-5d36ed125af6"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:44:27.505098 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-0836fd4d-bdc2-48a0-a633-bcddba87dc6b req-188c2976-41e7-4657-ad82-15a5670e7761 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:27.505566 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-0836fd4d-bdc2-48a0-a633-bcddba87dc6b req-188c2976-41e7-4657-ad82-15a5670e7761 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:27.506014 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-0836fd4d-bdc2-48a0-a633-bcddba87dc6b req-188c2976-41e7-4657-ad82-15a5670e7761 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:27.516744 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-0836fd4d-bdc2-48a0-a633-bcddba87dc6b req-188c2976-41e7-4657-ad82-15a5670e7761 service nova] Creating event network-vif-plugged:660352b3-2051-4619-91f9-5d36ed125af6 for instance acfe1a7b-9132-4df1-b530-f0d30f94f388 on hv-cinder-80135 Sep 05 12:44:27.522648 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-0836fd4d-bdc2-48a0-a633-bcddba87dc6b req-188c2976-41e7-4657-ad82-15a5670e7761 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032374 Sep 05 12:44:27.523222 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 588/1193] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 12:44:27.639377 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-aa7282f8-bbcd-4c78-906e-bc484ec670a7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:44:27.643312 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-aa7282f8-bbcd-4c78-906e-bc484ec670a7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:44:27.646008 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa7282f8-bbcd-4c78-906e-bc484ec670a7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:27.646493 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa7282f8-bbcd-4c78-906e-bc484ec670a7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:27.646965 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa7282f8-bbcd-4c78-906e-bc484ec670a7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:27.647674 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa7282f8-bbcd-4c78-906e-bc484ec670a7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:27.648127 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa7282f8-bbcd-4c78-906e-bc484ec670a7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:27.648550 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-aa7282f8-bbcd-4c78-906e-bc484ec670a7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:27.781342 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-aa7282f8-bbcd-4c78-906e-bc484ec670a7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:44:27.789020 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-aa7282f8-bbcd-4c78-906e-bc484ec670a7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1261 microversion: 2.1 time: 0.153447 Sep 05 12:44:27.792695 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 606/1194] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:44:27 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:44:28.814040 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-8c9b644f-13b1-4421-864e-4a385e9aab47 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:44:28.814732 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-8c9b644f-13b1-4421-864e-4a385e9aab47 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:44:28.820903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c9b644f-13b1-4421-864e-4a385e9aab47 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:28.821375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c9b644f-13b1-4421-864e-4a385e9aab47 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:28.821801 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c9b644f-13b1-4421-864e-4a385e9aab47 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:28.822474 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c9b644f-13b1-4421-864e-4a385e9aab47 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:28.822919 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c9b644f-13b1-4421-864e-4a385e9aab47 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:28.823334 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-8c9b644f-13b1-4421-864e-4a385e9aab47 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:28.958019 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-8c9b644f-13b1-4421-864e-4a385e9aab47 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:44:28.966337 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-8c9b644f-13b1-4421-864e-4a385e9aab47 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1261 microversion: 2.1 time: 0.157229 Sep 05 12:44:28.966902 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 589/1195] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:44:28 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:44:29.989450 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-67095f48-2afa-4944-ae93-0979403d9981 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:44:29.990138 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-67095f48-2afa-4944-ae93-0979403d9981 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:44:29.997038 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-67095f48-2afa-4944-ae93-0979403d9981 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:29.997515 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-67095f48-2afa-4944-ae93-0979403d9981 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:29.997943 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-67095f48-2afa-4944-ae93-0979403d9981 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:29.998624 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-67095f48-2afa-4944-ae93-0979403d9981 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:29.999070 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-67095f48-2afa-4944-ae93-0979403d9981 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:29.999492 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-67095f48-2afa-4944-ae93-0979403d9981 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:30.132833 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-67095f48-2afa-4944-ae93-0979403d9981 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:44:30.140782 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-67095f48-2afa-4944-ae93-0979403d9981 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1444 microversion: 2.1 time: 0.155124 Sep 05 12:44:30.141360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 607/1196] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:44:29 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:44:30.162714 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d7c1ac02-7be7-48b9-9791-1b2c89639737 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:44:30.163327 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d7c1ac02-7be7-48b9-9791-1b2c89639737 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:44:30.170295 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d7c1ac02-7be7-48b9-9791-1b2c89639737 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:30.170773 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d7c1ac02-7be7-48b9-9791-1b2c89639737 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:30.171202 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d7c1ac02-7be7-48b9-9791-1b2c89639737 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:30.172044 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d7c1ac02-7be7-48b9-9791-1b2c89639737 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:30.172495 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d7c1ac02-7be7-48b9-9791-1b2c89639737 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:30.172917 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d7c1ac02-7be7-48b9-9791-1b2c89639737 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:30.308049 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-d7c1ac02-7be7-48b9-9791-1b2c89639737 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:44:30.316076 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d7c1ac02-7be7-48b9-9791-1b2c89639737 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1444 microversion: 2.1 time: 0.157145 Sep 05 12:44:30.316654 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 590/1197] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:44:30 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:44:32.334400 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-2e491575-ea8b-4551-b338-b04deeddba6c req-18e171eb-a647-451b-9e3e-d1e1fa8e27d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acfe1a7b-9132-4df1-b530-f0d30f94f388", "tag": "660352b3-2051-4619-91f9-5d36ed125af6"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:44:32.344857 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-2e491575-ea8b-4551-b338-b04deeddba6c req-18e171eb-a647-451b-9e3e-d1e1fa8e27d0 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:44:32.345336 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-2e491575-ea8b-4551-b338-b04deeddba6c req-18e171eb-a647-451b-9e3e-d1e1fa8e27d0 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:44:32.345760 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-2e491575-ea8b-4551-b338-b04deeddba6c req-18e171eb-a647-451b-9e3e-d1e1fa8e27d0 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:44:32.357615 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-2e491575-ea8b-4551-b338-b04deeddba6c req-18e171eb-a647-451b-9e3e-d1e1fa8e27d0 service nova] Creating event network-changed:660352b3-2051-4619-91f9-5d36ed125af6 for instance acfe1a7b-9132-4df1-b530-f0d30f94f388 on hv-cinder-80135 Sep 05 12:44:32.362886 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-2e491575-ea8b-4551-b338-b04deeddba6c req-18e171eb-a647-451b-9e3e-d1e1fa8e27d0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086149 Sep 05 12:44:32.363490 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 608/1198] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:46:29.442643 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e385b8-14b4-4562-9c9d-7495a5f9c264] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 05 12:46:29.443213 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:46:29.443885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=58 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:46:29.444694 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 12:46:29.444823 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Mon Sep 5 12:46:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388/action (ip 10.222.0.62) !!! Sep 05 12:46:29.449966 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-525495f3-fd1c-47dd-a7ce-6e12527b3c6f tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:46:29.450494 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-525495f3-fd1c-47dd-a7ce-6e12527b3c6f tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:29.458054 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-525495f3-fd1c-47dd-a7ce-6e12527b3c6f tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:29.458537 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-525495f3-fd1c-47dd-a7ce-6e12527b3c6f tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:29.458971 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-525495f3-fd1c-47dd-a7ce-6e12527b3c6f tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:29.459691 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-525495f3-fd1c-47dd-a7ce-6e12527b3c6f tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:29.460144 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-525495f3-fd1c-47dd-a7ce-6e12527b3c6f tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:29.460563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-525495f3-fd1c-47dd-a7ce-6e12527b3c6f tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:29.482982 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.objects.instance [None req-525495f3-fd1c-47dd-a7ce-6e12527b3c6f tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lazy-loading 'flavor' on Instance uuid acfe1a7b-9132-4df1-b530-f0d30f94f388 {{(pid=121210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 12:46:29.725118 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-525495f3-fd1c-47dd-a7ce-6e12527b3c6f tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "POST /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388/action" status: 202 len: 0 microversion: 2.1 time: 0.284920 Sep 05 12:46:29.725642 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 591/1199] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Sep 5 12:46:29 2022] POST /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:46:29.734546 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72ca1c46-c623-4f0c-9dfd-0416df20c79a] AMQP server on 10.222.0.62:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 05 12:46:29.735321 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=24 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:46:29.736159 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=52 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:46:29.737209 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 12:46:29.737350 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Mon Sep 5 12:46:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 (ip 10.222.0.62) !!! Sep 05 12:46:29.749821 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-a7f14851-1fea-40c7-a345-03df992cd948 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:29.750524 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-a7f14851-1fea-40c7-a345-03df992cd948 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:29.757506 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a7f14851-1fea-40c7-a345-03df992cd948 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:29.757984 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a7f14851-1fea-40c7-a345-03df992cd948 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:29.758416 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a7f14851-1fea-40c7-a345-03df992cd948 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:29.759149 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a7f14851-1fea-40c7-a345-03df992cd948 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:29.759633 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a7f14851-1fea-40c7-a345-03df992cd948 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:29.760057 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-a7f14851-1fea-40c7-a345-03df992cd948 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:29.895464 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-a7f14851-1fea-40c7-a345-03df992cd948 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:29.903096 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-a7f14851-1fea-40c7-a345-03df992cd948 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1569 microversion: 2.1 time: 0.172888 Sep 05 12:46:29.903676 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 609/1200] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:29 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:30.928363 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-5ae980a8-92f4-47c0-bc28-33d8765807b7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:30.929087 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-5ae980a8-92f4-47c0-bc28-33d8765807b7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:30.936316 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5ae980a8-92f4-47c0-bc28-33d8765807b7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:30.936787 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5ae980a8-92f4-47c0-bc28-33d8765807b7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:30.937209 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5ae980a8-92f4-47c0-bc28-33d8765807b7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:30.937888 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5ae980a8-92f4-47c0-bc28-33d8765807b7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:30.938333 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5ae980a8-92f4-47c0-bc28-33d8765807b7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:30.938748 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-5ae980a8-92f4-47c0-bc28-33d8765807b7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:30.954818 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e385b8-14b4-4562-9c9d-7495a5f9c264] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 46058. Sep 05 12:46:31.074669 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-5ae980a8-92f4-47c0-bc28-33d8765807b7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:31.082639 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-5ae980a8-92f4-47c0-bc28-33d8765807b7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1569 microversion: 2.1 time: 0.160089 Sep 05 12:46:31.083215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 592/1201] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:30 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:32.105783 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-6c3b28e1-d21e-4a45-a96b-b454a99bae50 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:32.106420 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-6c3b28e1-d21e-4a45-a96b-b454a99bae50 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:32.113964 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c3b28e1-d21e-4a45-a96b-b454a99bae50 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:32.114448 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c3b28e1-d21e-4a45-a96b-b454a99bae50 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:32.114882 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c3b28e1-d21e-4a45-a96b-b454a99bae50 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:32.115596 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c3b28e1-d21e-4a45-a96b-b454a99bae50 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:32.116052 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c3b28e1-d21e-4a45-a96b-b454a99bae50 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:32.116474 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-6c3b28e1-d21e-4a45-a96b-b454a99bae50 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:32.122270 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO oslo.messaging._drivers.impl_rabbit [-] [72ca1c46-c623-4f0c-9dfd-0416df20c79a] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 46064. Sep 05 12:46:32.248124 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-6c3b28e1-d21e-4a45-a96b-b454a99bae50 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:32.256446 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-6c3b28e1-d21e-4a45-a96b-b454a99bae50 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1569 microversion: 2.1 time: 0.154554 Sep 05 12:46:32.257018 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 610/1202] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:32 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:33.281762 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-44a1712e-066f-49bb-9657-ff4022606297 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:33.282342 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-44a1712e-066f-49bb-9657-ff4022606297 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:33.288762 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-44a1712e-066f-49bb-9657-ff4022606297 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:33.289263 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-44a1712e-066f-49bb-9657-ff4022606297 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:33.289688 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-44a1712e-066f-49bb-9657-ff4022606297 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:33.290365 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-44a1712e-066f-49bb-9657-ff4022606297 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:33.290893 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-44a1712e-066f-49bb-9657-ff4022606297 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:33.291463 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-44a1712e-066f-49bb-9657-ff4022606297 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:33.424547 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-44a1712e-066f-49bb-9657-ff4022606297 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:33.432971 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-44a1712e-066f-49bb-9657-ff4022606297 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1569 microversion: 2.1 time: 0.156233 Sep 05 12:46:33.433526 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 593/1203] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:33 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:34.455968 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-536268ba-896c-4331-8184-b0f2517b3c18 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:34.456581 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-536268ba-896c-4331-8184-b0f2517b3c18 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:34.463570 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-536268ba-896c-4331-8184-b0f2517b3c18 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:34.464081 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-536268ba-896c-4331-8184-b0f2517b3c18 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:34.464518 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-536268ba-896c-4331-8184-b0f2517b3c18 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:34.465209 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-536268ba-896c-4331-8184-b0f2517b3c18 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:34.465698 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-536268ba-896c-4331-8184-b0f2517b3c18 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:34.466124 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-536268ba-896c-4331-8184-b0f2517b3c18 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:34.591589 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-536268ba-896c-4331-8184-b0f2517b3c18 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:34.599187 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-536268ba-896c-4331-8184-b0f2517b3c18 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1569 microversion: 2.1 time: 0.147058 Sep 05 12:46:34.599770 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 611/1204] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:34 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:35.622679 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-1b88a946-d8e4-4d2e-8388-aa8fa5af00b3 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:35.623319 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-1b88a946-d8e4-4d2e-8388-aa8fa5af00b3 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:35.629908 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1b88a946-d8e4-4d2e-8388-aa8fa5af00b3 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:35.630384 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1b88a946-d8e4-4d2e-8388-aa8fa5af00b3 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:35.630819 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1b88a946-d8e4-4d2e-8388-aa8fa5af00b3 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:35.631508 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1b88a946-d8e4-4d2e-8388-aa8fa5af00b3 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:35.631986 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1b88a946-d8e4-4d2e-8388-aa8fa5af00b3 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:35.632410 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-1b88a946-d8e4-4d2e-8388-aa8fa5af00b3 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:35.760572 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-1b88a946-d8e4-4d2e-8388-aa8fa5af00b3 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:35.768254 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-1b88a946-d8e4-4d2e-8388-aa8fa5af00b3 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1569 microversion: 2.1 time: 0.149438 Sep 05 12:46:35.768824 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 594/1205] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:35 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:36.791453 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f2b8bf77-212f-4a1d-be31-2ff9ba7fbacd tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:36.792102 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f2b8bf77-212f-4a1d-be31-2ff9ba7fbacd tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:36.798669 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f2b8bf77-212f-4a1d-be31-2ff9ba7fbacd tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:36.799222 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f2b8bf77-212f-4a1d-be31-2ff9ba7fbacd tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:36.799733 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f2b8bf77-212f-4a1d-be31-2ff9ba7fbacd tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:36.800416 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f2b8bf77-212f-4a1d-be31-2ff9ba7fbacd tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:36.801563 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f2b8bf77-212f-4a1d-be31-2ff9ba7fbacd tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:36.801985 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f2b8bf77-212f-4a1d-be31-2ff9ba7fbacd tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:36.931875 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f2b8bf77-212f-4a1d-be31-2ff9ba7fbacd tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:36.939517 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f2b8bf77-212f-4a1d-be31-2ff9ba7fbacd tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1569 microversion: 2.1 time: 0.151880 Sep 05 12:46:36.940100 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 612/1206] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:36 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:37.963060 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-a9499e24-1493-41c7-98a1-80cccaaa815d tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:37.963686 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-a9499e24-1493-41c7-98a1-80cccaaa815d tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:37.970096 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a9499e24-1493-41c7-98a1-80cccaaa815d tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:37.970569 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a9499e24-1493-41c7-98a1-80cccaaa815d tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:37.970996 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a9499e24-1493-41c7-98a1-80cccaaa815d tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:37.971713 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a9499e24-1493-41c7-98a1-80cccaaa815d tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:37.972164 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a9499e24-1493-41c7-98a1-80cccaaa815d tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:37.972585 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-a9499e24-1493-41c7-98a1-80cccaaa815d tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:38.107144 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-a9499e24-1493-41c7-98a1-80cccaaa815d tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:38.115569 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-a9499e24-1493-41c7-98a1-80cccaaa815d tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1569 microversion: 2.1 time: 0.156942 Sep 05 12:46:38.116180 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 595/1207] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:37 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:39.139694 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0758b296-5312-40a7-93d6-78204662032b tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:39.140271 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0758b296-5312-40a7-93d6-78204662032b tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:39.147470 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0758b296-5312-40a7-93d6-78204662032b tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:39.147968 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0758b296-5312-40a7-93d6-78204662032b tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:39.148393 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0758b296-5312-40a7-93d6-78204662032b tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:39.149070 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0758b296-5312-40a7-93d6-78204662032b tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:39.149524 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0758b296-5312-40a7-93d6-78204662032b tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:39.149938 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0758b296-5312-40a7-93d6-78204662032b tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:39.277007 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0758b296-5312-40a7-93d6-78204662032b tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:39.284831 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0758b296-5312-40a7-93d6-78204662032b tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1569 microversion: 2.1 time: 0.149184 Sep 05 12:46:39.285390 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 613/1208] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:39 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:40.308716 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4ae19ed4-b203-41f8-8e4c-ce6b2cfe5920 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:40.311165 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-4ae19ed4-b203-41f8-8e4c-ce6b2cfe5920 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:40.315961 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4ae19ed4-b203-41f8-8e4c-ce6b2cfe5920 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:40.316483 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4ae19ed4-b203-41f8-8e4c-ce6b2cfe5920 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:40.316916 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4ae19ed4-b203-41f8-8e4c-ce6b2cfe5920 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:40.317613 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4ae19ed4-b203-41f8-8e4c-ce6b2cfe5920 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:40.318063 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4ae19ed4-b203-41f8-8e4c-ce6b2cfe5920 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:40.318484 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4ae19ed4-b203-41f8-8e4c-ce6b2cfe5920 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:40.454600 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-4ae19ed4-b203-41f8-8e4c-ce6b2cfe5920 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:40.463012 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-4ae19ed4-b203-41f8-8e4c-ce6b2cfe5920 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1569 microversion: 2.1 time: 0.158192 Sep 05 12:46:40.463608 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 596/1209] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:40 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:41.486205 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-0d14829d-4d09-42c9-943f-f0bf4878f5c7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:41.486775 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-0d14829d-4d09-42c9-943f-f0bf4878f5c7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:41.493772 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0d14829d-4d09-42c9-943f-f0bf4878f5c7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:41.494246 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0d14829d-4d09-42c9-943f-f0bf4878f5c7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:41.494673 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0d14829d-4d09-42c9-943f-f0bf4878f5c7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:41.495348 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0d14829d-4d09-42c9-943f-f0bf4878f5c7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:41.495820 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0d14829d-4d09-42c9-943f-f0bf4878f5c7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:41.496238 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-0d14829d-4d09-42c9-943f-f0bf4878f5c7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:41.627649 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-0d14829d-4d09-42c9-943f-f0bf4878f5c7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:41.635707 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-0d14829d-4d09-42c9-943f-f0bf4878f5c7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1569 microversion: 2.1 time: 0.153282 Sep 05 12:46:41.636348 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 614/1210] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:41 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:42.658383 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-959c639d-2228-4c11-8ccc-b22fc1938b83 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:42.659000 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-959c639d-2228-4c11-8ccc-b22fc1938b83 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:42.665778 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-959c639d-2228-4c11-8ccc-b22fc1938b83 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:42.666254 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-959c639d-2228-4c11-8ccc-b22fc1938b83 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:42.666684 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-959c639d-2228-4c11-8ccc-b22fc1938b83 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:42.667369 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-959c639d-2228-4c11-8ccc-b22fc1938b83 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:42.667843 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-959c639d-2228-4c11-8ccc-b22fc1938b83 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:42.668264 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-959c639d-2228-4c11-8ccc-b22fc1938b83 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:42.801495 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-959c639d-2228-4c11-8ccc-b22fc1938b83 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:42.809807 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-959c639d-2228-4c11-8ccc-b22fc1938b83 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1569 microversion: 2.1 time: 0.155237 Sep 05 12:46:42.810381 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 597/1211] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:42 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:46:43.833133 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-2bd18114-6ca4-4a30-9bab-bb11e2170b2e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:43.833743 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-2bd18114-6ca4-4a30-9bab-bb11e2170b2e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:43.840032 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2bd18114-6ca4-4a30-9bab-bb11e2170b2e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:43.840500 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2bd18114-6ca4-4a30-9bab-bb11e2170b2e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:43.840923 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2bd18114-6ca4-4a30-9bab-bb11e2170b2e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:43.841597 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2bd18114-6ca4-4a30-9bab-bb11e2170b2e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:43.842038 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2bd18114-6ca4-4a30-9bab-bb11e2170b2e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:43.842470 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-2bd18114-6ca4-4a30-9bab-bb11e2170b2e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:44.232535 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-2bd18114-6ca4-4a30-9bab-bb11e2170b2e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:44.240940 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-2bd18114-6ca4-4a30-9bab-bb11e2170b2e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1570 microversion: 2.1 time: 0.411718 Sep 05 12:46:44.241504 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 615/1212] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:43 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1570 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:44.263780 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-d5ce46d6-cbe5-4eed-a06c-d1114873fbcf tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:46:44.264318 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d5ce46d6-cbe5-4eed-a06c-d1114873fbcf tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:44.270741 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d5ce46d6-cbe5-4eed-a06c-d1114873fbcf tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:44.271220 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d5ce46d6-cbe5-4eed-a06c-d1114873fbcf tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:44.271675 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d5ce46d6-cbe5-4eed-a06c-d1114873fbcf tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:44.272369 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d5ce46d6-cbe5-4eed-a06c-d1114873fbcf tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:44.272819 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d5ce46d6-cbe5-4eed-a06c-d1114873fbcf tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:44.273278 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-d5ce46d6-cbe5-4eed-a06c-d1114873fbcf tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:44.314156 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-d5ce46d6-cbe5-4eed-a06c-d1114873fbcf tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121210) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 05 12:46:44.551465 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-d5ce46d6-cbe5-4eed-a06c-d1114873fbcf tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "POST /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388/action" status: 202 len: 0 microversion: 2.1 time: 0.291660 Sep 05 12:46:44.552218 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 598/1213] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Sep 5 12:46:44 2022] POST /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 12:46:44.560305 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-ee0b57d4-00d0-4a7e-950e-55a30800ef9e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:44.560920 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-ee0b57d4-00d0-4a7e-950e-55a30800ef9e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:44.566844 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ee0b57d4-00d0-4a7e-950e-55a30800ef9e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:44.567327 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ee0b57d4-00d0-4a7e-950e-55a30800ef9e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:44.567802 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ee0b57d4-00d0-4a7e-950e-55a30800ef9e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:44.568497 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ee0b57d4-00d0-4a7e-950e-55a30800ef9e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:44.568956 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ee0b57d4-00d0-4a7e-950e-55a30800ef9e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:44.569371 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-ee0b57d4-00d0-4a7e-950e-55a30800ef9e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:44.699403 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-ee0b57d4-00d0-4a7e-950e-55a30800ef9e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:44.707157 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-ee0b57d4-00d0-4a7e-950e-55a30800ef9e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1518 microversion: 2.1 time: 0.150755 Sep 05 12:46:44.707769 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 616/1214] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:44 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:45.731475 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-f409f7a9-f183-4750-9a3b-69b9e243a392 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:45.732088 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-f409f7a9-f183-4750-9a3b-69b9e243a392 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:45.738469 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f409f7a9-f183-4750-9a3b-69b9e243a392 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:45.741201 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f409f7a9-f183-4750-9a3b-69b9e243a392 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:45.741201 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f409f7a9-f183-4750-9a3b-69b9e243a392 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:45.741201 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f409f7a9-f183-4750-9a3b-69b9e243a392 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:45.741587 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f409f7a9-f183-4750-9a3b-69b9e243a392 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:45.742011 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f409f7a9-f183-4750-9a3b-69b9e243a392 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:45.876544 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f409f7a9-f183-4750-9a3b-69b9e243a392 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:45.885098 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-f409f7a9-f183-4750-9a3b-69b9e243a392 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1518 microversion: 2.1 time: 0.158077 Sep 05 12:46:45.885669 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 599/1215] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:45 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:46.110740 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-9a49ac50-8a6e-4445-b929-e4300a3b4b6e req-e3b31b43-3b10-4e79-b279-019ca6eac790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfe1a7b-9132-4df1-b530-f0d30f94f388", "name": "network-vif-unplugged", "status": "completed", "tag": "660352b3-2051-4619-91f9-5d36ed125af6"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:46:46.120604 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-9a49ac50-8a6e-4445-b929-e4300a3b4b6e req-e3b31b43-3b10-4e79-b279-019ca6eac790 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:46.121232 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-9a49ac50-8a6e-4445-b929-e4300a3b4b6e req-e3b31b43-3b10-4e79-b279-019ca6eac790 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:46.121662 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-9a49ac50-8a6e-4445-b929-e4300a3b4b6e req-e3b31b43-3b10-4e79-b279-019ca6eac790 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:46.134198 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.compute.server_external_events [req-9a49ac50-8a6e-4445-b929-e4300a3b4b6e req-e3b31b43-3b10-4e79-b279-019ca6eac790 service nova] Unable to find a host for instance acfe1a7b-9132-4df1-b530-f0d30f94f388. Dropping event network-vif-unplugged {{(pid=121211) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 05 12:46:46.139457 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-9a49ac50-8a6e-4445-b929-e4300a3b4b6e req-e3b31b43-3b10-4e79-b279-019ca6eac790 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.086747 Sep 05 12:46:46.139457 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 617/1216] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 88 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 05 12:46:46.908038 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-45228731-8264-47ed-9d0a-50458b230dad tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:46.908645 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-45228731-8264-47ed-9d0a-50458b230dad tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:46.915270 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-45228731-8264-47ed-9d0a-50458b230dad tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:46.915836 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-45228731-8264-47ed-9d0a-50458b230dad tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:46.916270 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-45228731-8264-47ed-9d0a-50458b230dad tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:46.916982 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-45228731-8264-47ed-9d0a-50458b230dad tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:46.917429 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-45228731-8264-47ed-9d0a-50458b230dad tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:46.917846 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-45228731-8264-47ed-9d0a-50458b230dad tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:47.047922 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-45228731-8264-47ed-9d0a-50458b230dad tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:47.056415 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-45228731-8264-47ed-9d0a-50458b230dad tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1520 microversion: 2.1 time: 0.152235 Sep 05 12:46:47.056979 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 600/1217] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:46 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:48.080692 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-e8d74fa8-b6bb-4054-81ea-57d1ca9c9e00 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:48.081303 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-e8d74fa8-b6bb-4054-81ea-57d1ca9c9e00 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:48.088286 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8d74fa8-b6bb-4054-81ea-57d1ca9c9e00 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:48.088820 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8d74fa8-b6bb-4054-81ea-57d1ca9c9e00 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:48.089246 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8d74fa8-b6bb-4054-81ea-57d1ca9c9e00 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:48.089930 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8d74fa8-b6bb-4054-81ea-57d1ca9c9e00 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:48.090378 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8d74fa8-b6bb-4054-81ea-57d1ca9c9e00 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:48.090795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-e8d74fa8-b6bb-4054-81ea-57d1ca9c9e00 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:48.306480 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-e8d74fa8-b6bb-4054-81ea-57d1ca9c9e00 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:48.314305 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-e8d74fa8-b6bb-4054-81ea-57d1ca9c9e00 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1576 microversion: 2.1 time: 0.237498 Sep 05 12:46:48.314877 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 618/1218] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:48 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1576 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:49.338770 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-4ac9d851-9eba-4283-9e02-ef9a7d42b103 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:49.339322 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-4ac9d851-9eba-4283-9e02-ef9a7d42b103 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:49.346017 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4ac9d851-9eba-4283-9e02-ef9a7d42b103 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:49.346496 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4ac9d851-9eba-4283-9e02-ef9a7d42b103 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:49.346934 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4ac9d851-9eba-4283-9e02-ef9a7d42b103 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:49.347639 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4ac9d851-9eba-4283-9e02-ef9a7d42b103 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:49.348091 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4ac9d851-9eba-4283-9e02-ef9a7d42b103 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:49.348511 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-4ac9d851-9eba-4283-9e02-ef9a7d42b103 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:49.481725 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-4ac9d851-9eba-4283-9e02-ef9a7d42b103 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:49.489275 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-4ac9d851-9eba-4283-9e02-ef9a7d42b103 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1576 microversion: 2.1 time: 0.154493 Sep 05 12:46:49.489837 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 601/1219] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:49 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:50.513106 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-75ce820e-1ff9-4be6-bcd3-2c38845e2fa7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:50.513725 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-75ce820e-1ff9-4be6-bcd3-2c38845e2fa7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:50.520162 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-75ce820e-1ff9-4be6-bcd3-2c38845e2fa7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:50.520641 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-75ce820e-1ff9-4be6-bcd3-2c38845e2fa7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:50.521074 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-75ce820e-1ff9-4be6-bcd3-2c38845e2fa7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:50.521761 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-75ce820e-1ff9-4be6-bcd3-2c38845e2fa7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:50.522214 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-75ce820e-1ff9-4be6-bcd3-2c38845e2fa7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:50.522637 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-75ce820e-1ff9-4be6-bcd3-2c38845e2fa7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:50.649219 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-75ce820e-1ff9-4be6-bcd3-2c38845e2fa7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:50.656925 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-75ce820e-1ff9-4be6-bcd3-2c38845e2fa7 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1576 microversion: 2.1 time: 0.147749 Sep 05 12:46:50.657486 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 619/1220] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:50 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 12:46:51.679855 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-c2a7e9c9-a0aa-4197-bf24-bdcc83373c1e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:51.680468 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-c2a7e9c9-a0aa-4197-bf24-bdcc83373c1e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:51.686962 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c2a7e9c9-a0aa-4197-bf24-bdcc83373c1e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:51.687478 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c2a7e9c9-a0aa-4197-bf24-bdcc83373c1e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:51.687938 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c2a7e9c9-a0aa-4197-bf24-bdcc83373c1e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:51.688632 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c2a7e9c9-a0aa-4197-bf24-bdcc83373c1e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:51.689084 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c2a7e9c9-a0aa-4197-bf24-bdcc83373c1e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:51.689503 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-c2a7e9c9-a0aa-4197-bf24-bdcc83373c1e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:51.819921 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-c2a7e9c9-a0aa-4197-bf24-bdcc83373c1e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:51.827499 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-c2a7e9c9-a0aa-4197-bf24-bdcc83373c1e tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1576 microversion: 2.1 time: 0.151577 Sep 05 12:46:51.828089 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 602/1221] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:51 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:52.853331 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-149b1e58-2aeb-4300-8b9c-d3adf7ecb575 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:52.853968 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-149b1e58-2aeb-4300-8b9c-d3adf7ecb575 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:52.860439 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-149b1e58-2aeb-4300-8b9c-d3adf7ecb575 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:52.860913 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-149b1e58-2aeb-4300-8b9c-d3adf7ecb575 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:52.861341 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-149b1e58-2aeb-4300-8b9c-d3adf7ecb575 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:52.862017 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-149b1e58-2aeb-4300-8b9c-d3adf7ecb575 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:52.862460 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-149b1e58-2aeb-4300-8b9c-d3adf7ecb575 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:52.862876 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-149b1e58-2aeb-4300-8b9c-d3adf7ecb575 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:52.990986 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-149b1e58-2aeb-4300-8b9c-d3adf7ecb575 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:52.998626 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-149b1e58-2aeb-4300-8b9c-d3adf7ecb575 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1576 microversion: 2.1 time: 0.150003 Sep 05 12:46:52.999188 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 620/1222] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:52 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:54.021799 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-f0bee19c-d944-4d8f-adfc-9d17cbb826a3 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:54.022417 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-f0bee19c-d944-4d8f-adfc-9d17cbb826a3 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:54.028930 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f0bee19c-d944-4d8f-adfc-9d17cbb826a3 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:54.029408 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f0bee19c-d944-4d8f-adfc-9d17cbb826a3 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:54.029845 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f0bee19c-d944-4d8f-adfc-9d17cbb826a3 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:54.030529 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f0bee19c-d944-4d8f-adfc-9d17cbb826a3 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:54.030977 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f0bee19c-d944-4d8f-adfc-9d17cbb826a3 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:54.031394 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-f0bee19c-d944-4d8f-adfc-9d17cbb826a3 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:54.165864 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-f0bee19c-d944-4d8f-adfc-9d17cbb826a3 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:54.173401 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-f0bee19c-d944-4d8f-adfc-9d17cbb826a3 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1576 microversion: 2.1 time: 0.155466 Sep 05 12:46:54.173958 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 603/1223] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:54 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:55.197258 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-b4960ac6-101d-420b-b850-e95af076127a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:55.197870 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-b4960ac6-101d-420b-b850-e95af076127a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:55.204273 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b4960ac6-101d-420b-b850-e95af076127a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:55.204745 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b4960ac6-101d-420b-b850-e95af076127a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:55.205172 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b4960ac6-101d-420b-b850-e95af076127a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:55.205847 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b4960ac6-101d-420b-b850-e95af076127a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:55.206294 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b4960ac6-101d-420b-b850-e95af076127a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:55.206710 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-b4960ac6-101d-420b-b850-e95af076127a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:55.339638 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-b4960ac6-101d-420b-b850-e95af076127a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:55.347166 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-b4960ac6-101d-420b-b850-e95af076127a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1576 microversion: 2.1 time: 0.154394 Sep 05 12:46:55.347823 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 621/1224] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:55 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:56.372157 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-bbb66e67-b111-4790-a940-0249f85f2591 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:56.372769 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-bbb66e67-b111-4790-a940-0249f85f2591 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:56.379372 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bbb66e67-b111-4790-a940-0249f85f2591 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:56.379878 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bbb66e67-b111-4790-a940-0249f85f2591 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:56.380300 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bbb66e67-b111-4790-a940-0249f85f2591 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:56.380980 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bbb66e67-b111-4790-a940-0249f85f2591 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:56.381424 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bbb66e67-b111-4790-a940-0249f85f2591 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:56.381858 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-bbb66e67-b111-4790-a940-0249f85f2591 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:56.400388 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:46:56.511346 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-bbb66e67-b111-4790-a940-0249f85f2591 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:56.518903 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-bbb66e67-b111-4790-a940-0249f85f2591 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1576 microversion: 2.1 time: 0.150641 Sep 05 12:46:56.519467 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 604/1225] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:56 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:57.542391 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-1cd1ef87-9c6b-43ac-b69d-fded4c948e8a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:57.543006 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-1cd1ef87-9c6b-43ac-b69d-fded4c948e8a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:57.549328 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1cd1ef87-9c6b-43ac-b69d-fded4c948e8a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:57.549814 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1cd1ef87-9c6b-43ac-b69d-fded4c948e8a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:57.550248 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1cd1ef87-9c6b-43ac-b69d-fded4c948e8a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:57.550930 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1cd1ef87-9c6b-43ac-b69d-fded4c948e8a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:57.551391 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1cd1ef87-9c6b-43ac-b69d-fded4c948e8a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:57.551842 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-1cd1ef87-9c6b-43ac-b69d-fded4c948e8a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:57.679019 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-1cd1ef87-9c6b-43ac-b69d-fded4c948e8a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:57.686798 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-1cd1ef87-9c6b-43ac-b69d-fded4c948e8a tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1576 microversion: 2.1 time: 0.148846 Sep 05 12:46:57.687362 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 622/1226] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:57 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:58.172882 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-244630df-6a27-42a2-a02d-c9b8074d3d05 req-2845df39-2e55-4794-8a3a-d84404f6b458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfe1a7b-9132-4df1-b530-f0d30f94f388", "name": "network-vif-plugged", "status": "completed", "tag": "660352b3-2051-4619-91f9-5d36ed125af6"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:46:58.183057 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-244630df-6a27-42a2-a02d-c9b8074d3d05 req-2845df39-2e55-4794-8a3a-d84404f6b458 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:58.183524 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-244630df-6a27-42a2-a02d-c9b8074d3d05 req-2845df39-2e55-4794-8a3a-d84404f6b458 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:58.183965 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-244630df-6a27-42a2-a02d-c9b8074d3d05 req-2845df39-2e55-4794-8a3a-d84404f6b458 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:58.194715 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-244630df-6a27-42a2-a02d-c9b8074d3d05 req-2845df39-2e55-4794-8a3a-d84404f6b458 service nova] Creating event network-vif-plugged:660352b3-2051-4619-91f9-5d36ed125af6 for instance acfe1a7b-9132-4df1-b530-f0d30f94f388 on hv-cinder-80135 Sep 05 12:46:58.200733 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-244630df-6a27-42a2-a02d-c9b8074d3d05 req-2845df39-2e55-4794-8a3a-d84404f6b458 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031471 Sep 05 12:46:58.201309 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 605/1227] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:46:58.711067 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-56756d6a-f6b0-47a0-bf6e-73e778aa4f55 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:58.711702 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-56756d6a-f6b0-47a0-bf6e-73e778aa4f55 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:58.718034 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-56756d6a-f6b0-47a0-bf6e-73e778aa4f55 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:58.718574 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-56756d6a-f6b0-47a0-bf6e-73e778aa4f55 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:58.719000 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-56756d6a-f6b0-47a0-bf6e-73e778aa4f55 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:58.719711 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-56756d6a-f6b0-47a0-bf6e-73e778aa4f55 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:58.720160 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-56756d6a-f6b0-47a0-bf6e-73e778aa4f55 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:58.720577 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-56756d6a-f6b0-47a0-bf6e-73e778aa4f55 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:58.849789 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-56756d6a-f6b0-47a0-bf6e-73e778aa4f55 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:46:58.858040 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-56756d6a-f6b0-47a0-bf6e-73e778aa4f55 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1576 microversion: 2.1 time: 0.151438 Sep 05 12:46:58.858612 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 623/1228] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:58 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:46:59.881888 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-10998461-dc10-48a4-be25-ae3a066415bb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:46:59.883131 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-10998461-dc10-48a4-be25-ae3a066415bb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:46:59.885537 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:46:59.890314 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-10998461-dc10-48a4-be25-ae3a066415bb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:59.890786 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-10998461-dc10-48a4-be25-ae3a066415bb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:59.891215 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-10998461-dc10-48a4-be25-ae3a066415bb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:46:59.891978 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-10998461-dc10-48a4-be25-ae3a066415bb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:46:59.892375 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-10998461-dc10-48a4-be25-ae3a066415bb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:46:59.892788 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-10998461-dc10-48a4-be25-ae3a066415bb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:47:00.029487 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-10998461-dc10-48a4-be25-ae3a066415bb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:47:00.037682 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-10998461-dc10-48a4-be25-ae3a066415bb tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1576 microversion: 2.1 time: 0.160283 Sep 05 12:47:00.038502 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 606/1229] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:46:59 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:47:01.061579 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-fb2ad9b3-d8d6-49f5-aa03-e78243c008b0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:47:01.062191 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-fb2ad9b3-d8d6-49f5-aa03-e78243c008b0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:47:01.064573 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=31 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:47:01.069257 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fb2ad9b3-d8d6-49f5-aa03-e78243c008b0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:47:01.069734 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fb2ad9b3-d8d6-49f5-aa03-e78243c008b0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:47:01.070659 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fb2ad9b3-d8d6-49f5-aa03-e78243c008b0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:47:01.071346 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fb2ad9b3-d8d6-49f5-aa03-e78243c008b0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:47:01.071821 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fb2ad9b3-d8d6-49f5-aa03-e78243c008b0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:47:01.072238 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fb2ad9b3-d8d6-49f5-aa03-e78243c008b0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:47:01.074795 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=87 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:47:01.200089 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-fb2ad9b3-d8d6-49f5-aa03-e78243c008b0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:47:01.207727 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-fb2ad9b3-d8d6-49f5-aa03-e78243c008b0 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1563 microversion: 2.1 time: 0.149952 Sep 05 12:47:01.208293 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 624/1230] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:47:01 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:48:15.807021 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_api:SELECT=1 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:48:15.808136 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG dbcounter [-] [121210] Writing DB stats nova_cell1:SELECT=10 {{(pid=121210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:48:15.808587 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_api:SELECT=1 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:48:15.809259 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG dbcounter [-] [121211] Writing DB stats nova_cell1:SELECT=5 {{(pid=121211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:48:15.810347 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 12:48:15.810487 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Mon Sep 5 12:48:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.62) !!! Sep 05 12:48:15.812090 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 12:48:15.812090 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: Mon Sep 5 12:48:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.62) !!! Sep 05 12:48:15.815197 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-dfa5378d-04f2-4209-8bbe-da7dc773c132 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:48:15.815885 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-dfa5378d-04f2-4209-8bbe-da7dc773c132 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:48:15.816106 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [req-09e10dc3-83e4-4db8-b52f-b4d0f98ae8df req-2d203991-53e4-49c6-965d-9e9e08ff7859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acfe1a7b-9132-4df1-b530-f0d30f94f388", "tag": "660352b3-2051-4619-91f9-5d36ed125af6"}]} {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:48:15.824505 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-dfa5378d-04f2-4209-8bbe-da7dc773c132 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:48:15.825080 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-dfa5378d-04f2-4209-8bbe-da7dc773c132 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:48:15.825572 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-dfa5378d-04f2-4209-8bbe-da7dc773c132 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:48:15.826347 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-dfa5378d-04f2-4209-8bbe-da7dc773c132 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:48:15.827417 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-dfa5378d-04f2-4209-8bbe-da7dc773c132 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:48:15.828949 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-dfa5378d-04f2-4209-8bbe-da7dc773c132 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:48:15.829683 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-09e10dc3-83e4-4db8-b52f-b4d0f98ae8df req-2d203991-53e4-49c6-965d-9e9e08ff7859 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:48:15.830167 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-09e10dc3-83e4-4db8-b52f-b4d0f98ae8df req-2d203991-53e4-49c6-965d-9e9e08ff7859 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:48:15.830603 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [req-09e10dc3-83e4-4db8-b52f-b4d0f98ae8df req-2d203991-53e4-49c6-965d-9e9e08ff7859 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:48:15.843220 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.compute.server_external_events [req-09e10dc3-83e4-4db8-b52f-b4d0f98ae8df req-2d203991-53e4-49c6-965d-9e9e08ff7859 service nova] Creating event network-changed:660352b3-2051-4619-91f9-5d36ed125af6 for instance acfe1a7b-9132-4df1-b530-f0d30f94f388 on hv-cinder-80135 Sep 05 12:48:15.849360 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [req-09e10dc3-83e4-4db8-b52f-b4d0f98ae8df req-2d203991-53e4-49c6-965d-9e9e08ff7859 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042338 Sep 05 12:48:15.849972 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 625/1231] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:48:15.865437 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-dfa5378d-04f2-4209-8bbe-da7dc773c132 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Going to try to terminate instance {{(pid=121210) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 12:48:16.189560 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-dfa5378d-04f2-4209-8bbe-da7dc773c132 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "DELETE /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 204 len: 0 microversion: 2.1 time: 0.384484 Sep 05 12:48:16.191050 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 607/1232] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Sep 5 12:48:15 2022] DELETE /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 12:48:16.200316 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-fea50ae0-6ac0-4898-9af3-fd3cb01203d8 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:48:16.201389 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-fea50ae0-6ac0-4898-9af3-fd3cb01203d8 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:48:16.210039 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fea50ae0-6ac0-4898-9af3-fd3cb01203d8 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:48:16.210763 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fea50ae0-6ac0-4898-9af3-fd3cb01203d8 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:48:16.211418 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fea50ae0-6ac0-4898-9af3-fd3cb01203d8 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:48:16.212402 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fea50ae0-6ac0-4898-9af3-fd3cb01203d8 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:48:16.212863 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fea50ae0-6ac0-4898-9af3-fd3cb01203d8 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:48:16.213288 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-fea50ae0-6ac0-4898-9af3-fd3cb01203d8 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:48:16.347171 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-fea50ae0-6ac0-4898-9af3-fd3cb01203d8 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:48:16.354942 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-fea50ae0-6ac0-4898-9af3-fd3cb01203d8 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1569 microversion: 2.1 time: 0.159659 Sep 05 12:48:16.355514 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 626/1233] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:48:16 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:48:17.379368 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-0b63e1f9-6928-4bef-95f2-da414cd20786 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:48:17.380021 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-0b63e1f9-6928-4bef-95f2-da414cd20786 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:48:17.386697 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0b63e1f9-6928-4bef-95f2-da414cd20786 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:48:17.387170 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0b63e1f9-6928-4bef-95f2-da414cd20786 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:48:17.387618 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0b63e1f9-6928-4bef-95f2-da414cd20786 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:48:17.388308 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0b63e1f9-6928-4bef-95f2-da414cd20786 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:48:17.388753 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0b63e1f9-6928-4bef-95f2-da414cd20786 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:48:17.389688 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-0b63e1f9-6928-4bef-95f2-da414cd20786 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:48:17.518075 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.policy [None req-0b63e1f9-6928-4bef-95f2-da414cd20786 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121210) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:48:17.525766 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-0b63e1f9-6928-4bef-95f2-da414cd20786 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1569 microversion: 2.1 time: 0.150951 Sep 05 12:48:17.534957 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 608/1234] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:48:17 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:48:18.550229 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-f09e88da-60df-479f-8ceb-443d50aaf4db tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:48:18.550944 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-f09e88da-60df-479f-8ceb-443d50aaf4db tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:48:18.557581 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f09e88da-60df-479f-8ceb-443d50aaf4db tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:48:18.558152 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f09e88da-60df-479f-8ceb-443d50aaf4db tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:48:18.558649 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f09e88da-60df-479f-8ceb-443d50aaf4db tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:48:18.559346 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f09e88da-60df-479f-8ceb-443d50aaf4db tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:48:18.559816 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f09e88da-60df-479f-8ceb-443d50aaf4db tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:48:18.560235 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-f09e88da-60df-479f-8ceb-443d50aaf4db tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:48:18.744636 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-f09e88da-60df-479f-8ceb-443d50aaf4db tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:48:18.752405 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-f09e88da-60df-479f-8ceb-443d50aaf4db tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1450 microversion: 2.1 time: 0.206004 Sep 05 12:48:18.752972 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 627/1235] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:48:18 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1450 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:48:19.007332 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [req-e9d86286-4b17-4771-b9c9-08f9c1fe0f5e req-421ecb65-faf3-4d6d-a65b-6e02b1b3df67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfe1a7b-9132-4df1-b530-f0d30f94f388", "name": "network-vif-deleted", "tag": "660352b3-2051-4619-91f9-5d36ed125af6"}]} {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 12:48:19.018356 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-e9d86286-4b17-4771-b9c9-08f9c1fe0f5e req-421ecb65-faf3-4d6d-a65b-6e02b1b3df67 service nova] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:48:19.020293 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-e9d86286-4b17-4771-b9c9-08f9c1fe0f5e req-421ecb65-faf3-4d6d-a65b-6e02b1b3df67 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:48:19.020293 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [req-e9d86286-4b17-4771-b9c9-08f9c1fe0f5e req-421ecb65-faf3-4d6d-a65b-6e02b1b3df67 service nova] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:48:19.031502 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.compute.server_external_events [req-e9d86286-4b17-4771-b9c9-08f9c1fe0f5e req-421ecb65-faf3-4d6d-a65b-6e02b1b3df67 service nova] Creating event network-vif-deleted:660352b3-2051-4619-91f9-5d36ed125af6 for instance acfe1a7b-9132-4df1-b530-f0d30f94f388 on hv-cinder-80135 Sep 05 12:48:19.036479 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [req-e9d86286-4b17-4771-b9c9-08f9c1fe0f5e req-421ecb65-faf3-4d6d-a65b-6e02b1b3df67 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140017 Sep 05 12:48:19.037058 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 609/1236] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Sep 5 12:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 12:48:19.776624 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-45a6fcf6-f0e1-4381-b98a-734e28829d4c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:48:19.777252 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.compute.api [None req-45a6fcf6-f0e1-4381-b98a-734e28829d4c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121211) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:48:19.783799 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-45a6fcf6-f0e1-4381-b98a-734e28829d4c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:48:19.784289 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-45a6fcf6-f0e1-4381-b98a-734e28829d4c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:48:19.784756 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-45a6fcf6-f0e1-4381-b98a-734e28829d4c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:48:19.785467 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-45a6fcf6-f0e1-4381-b98a-734e28829d4c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:48:19.785954 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-45a6fcf6-f0e1-4381-b98a-734e28829d4c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:48:19.786401 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG oslo_concurrency.lockutils [None req-45a6fcf6-f0e1-4381-b98a-734e28829d4c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:48:19.848654 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.policy [None req-45a6fcf6-f0e1-4381-b98a-734e28829d4c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4315027930746c2b037efa139531914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a867fbd2d444728391be6de51146c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121211) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 12:48:19.856687 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-45a6fcf6-f0e1-4381-b98a-734e28829d4c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 200 len: 1220 microversion: 2.1 time: 0.084055 Sep 05 12:48:19.857249 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 628/1237] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:48:19 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 12:48:20.881630 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7e6a3128-4769-4288-811a-4c28e6f9570c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '>' {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:48:20.882328 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.compute.api [None req-7e6a3128-4769-4288-811a-4c28e6f9570c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] [instance: acfe1a7b-9132-4df1-b530-f0d30f94f388] Fetching instance by UUID {{(pid=121210) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 12:48:20.888449 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7e6a3128-4769-4288-811a-4c28e6f9570c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:48:20.889582 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7e6a3128-4769-4288-811a-4c28e6f9570c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:48:20.890023 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7e6a3128-4769-4288-811a-4c28e6f9570c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:48:20.890714 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7e6a3128-4769-4288-811a-4c28e6f9570c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Acquiring lock "81343397-9614-45e8-9ed8-cbb978677508" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 12:48:20.891170 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7e6a3128-4769-4288-811a-4c28e6f9570c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 12:48:20.891619 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG oslo_concurrency.lockutils [None req-7e6a3128-4769-4288-811a-4c28e6f9570c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Lock "81343397-9614-45e8-9ed8-cbb978677508" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 12:48:20.904479 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.wsgi [None req-7e6a3128-4769-4288-811a-4c28e6f9570c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] HTTP exception thrown: Instance acfe1a7b-9132-4df1-b530-f0d30f94f388 could not be found. Sep 05 12:48:20.906563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7e6a3128-4769-4288-811a-4c28e6f9570c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Request method failure captured: Sep 05 12:48:20.906563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: request: GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 HTTP/1.1 Sep 05 12:48:20.906563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept: application/json Sep 05 12:48:20.906563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Accept-Encoding: identity Sep 05 12:48:20.906563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Connection: close Sep 05 12:48:20.906563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Length: 0 Sep 05 12:48:20.906563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Content-Type: application/json Sep 05 12:48:20.906563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Host: 10.222.0.62 Sep 05 12:48:20.906563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: Openstack-System-Scope: None Sep 05 12:48:20.906563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: User-Agent: python-urllib3/1.26.12 Sep 05 12:48:20.906563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Auth-Token: gAAAAABjFe7-VeE8cBpYEBw3f27c9-xhPvItb-qZpYJEu3nNuNidVv-_qT_F1JJCG8geUxpyKG7Et3Bo7m4QH0SL5nyBAgedzefYPGQdvFXzbjRqEt4i8j6XrogO2Znsv7mMY2MP7saYYCxYn-uk5cIb39QQHO16Qc7DhldAFjIRHr_1voxFGiU Sep 05 12:48:20.906563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Id: None Sep 05 12:48:20.906563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Domain-Name: None Sep 05 12:48:20.906563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Identity-Status: Confirmed Sep 05 12:48:20.906563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Is-Admin-Project: True Sep 05 12:48:20.906563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Id: default Sep 05 12:48:20.906563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Domain-Name: Default Sep 05 12:48:20.906563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Id: 58a867fbd2d444728391be6de51146c9 Sep 05 12:48:20.906563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Project-Name: tempest-TestShelveInstance-1702941696 Sep 05 12:48:20.906563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Role: member,reader Sep 05 12:48:20.906563 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Roles: member,reader Sep 05 12:48:20.908368 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/58a867fbd2d444728391be6de51146c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/58a867fbd2d444728391be6de51146c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/58a867fbd2d444728391be6de51146c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_58a867fbd2d444728391be6de51146c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Sep 05 12:48:20.908368 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant: tempest-TestShelveInstance-1702941696 Sep 05 12:48:20.908368 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Id: 58a867fbd2d444728391be6de51146c9 Sep 05 12:48:20.908368 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-Tenant-Name: tempest-TestShelveInstance-1702941696 Sep 05 12:48:20.908368 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User: tempest-TestShelveInstance-1702941696-project Sep 05 12:48:20.908368 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Id: default Sep 05 12:48:20.908368 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Domain-Name: Default Sep 05 12:48:20.908368 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Id: e4315027930746c2b037efa139531914 Sep 05 12:48:20.908368 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: X-User-Name: tempest-TestShelveInstance-1702941696-project Sep 05 12:48:20.908368 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: method: > Sep 05 12:48:20.908368 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: exception: Instance acfe1a7b-9132-4df1-b530-f0d30f94f388 could not be found. Sep 05 12:48:20.908368 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: action_args: {'id': 'acfe1a7b-9132-4df1-b530-f0d30f94f388'} Sep 05 12:48:20.909609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: {{(pid=121210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 12:48:20.909609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:48:20.909609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 12:48:20.909609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 12:48:20.909609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 12:48:20.909609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 12:48:20.909609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 12:48:20.909609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 12:48:20.909609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 12:48:20.909609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 12:48:20.909609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acfe1a7b-9132-4df1-b530-f0d30f94f388 could not be found. Sep 05 12:48:20.909609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:48:20.909609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:48:20.909609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:48:20.909609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:48:20.909609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:48:20.909609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:48:20.909609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 12:48:20.909609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 12:48:20.909609 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 12:48:20.911543 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 12:48:20.911543 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 12:48:20.911543 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 12:48:20.911543 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 12:48:20.911543 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 12:48:20.911543 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 12:48:20.911543 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 12:48:20.911543 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acfe1a7b-9132-4df1-b530-f0d30f94f388 could not be found. Sep 05 12:48:20.911543 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:48:20.911543 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 12:48:20.911543 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:48:20.911543 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 12:48:20.911543 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 12:48:20.911543 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 12:48:20.911543 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 12:48:20.911543 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 12:48:20.911543 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acfe1a7b-9132-4df1-b530-f0d30f94f388 could not be found. Sep 05 12:48:20.911543 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: ERROR nova.api.openstack.wsgi Sep 05 12:48:20.913138 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: DEBUG nova.api.openstack.wsgi [None req-7e6a3128-4769-4288-811a-4c28e6f9570c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Returning 404 to user: Instance acfe1a7b-9132-4df1-b530-f0d30f94f388 could not be found. {{(pid=121210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 12:48:20.913138 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: INFO nova.api.openstack.requestlog [None req-7e6a3128-4769-4288-811a-4c28e6f9570c tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388" status: 404 len: 111 microversion: 2.1 time: 0.031233 Sep 05 12:48:20.913138 dv-cinder-801354-7-iscsi devstack@n-api.service[121210]: [pid: 121210|app: 0|req: 610/1238] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Sep 5 12:48:20 2022] GET /compute/v2.1/servers/acfe1a7b-9132-4df1-b530-f0d30f94f388 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 12:48:21.150627 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: DEBUG nova.api.openstack.wsgi [None req-4be54f01-0bbf-42bb-abf8-cdc53f948494 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] Calling method '.version_select at 0x7fe712a90e50>' {{(pid=121211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 12:48:21.243837 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: INFO nova.api.openstack.requestlog [None req-4be54f01-0bbf-42bb-abf8-cdc53f948494 tempest-TestShelveInstance-1702941696 tempest-TestShelveInstance-1702941696-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1935271163" status: 202 len: 0 microversion: 2.1 time: 0.096900 Sep 05 12:48:21.244365 dv-cinder-801354-7-iscsi devstack@n-api.service[121211]: [pid: 121211|app: 0|req: 629/1239] 10.222.0.62 () {58 vars in 1254 bytes} [Mon Sep 5 12:48:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1935271163 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)